2023-11-11 11:53:15,624 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-11 11:53:15,884 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884 2023-11-11 11:53:15,899 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-11 11:53:15,899 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/cluster_ba247ec2-1551-003a-d119-7315b0da3078, deleteOnExit=true 2023-11-11 11:53:15,899 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-11 11:53:15,900 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/test.cache.data in system properties and HBase conf 2023-11-11 11:53:15,900 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/hadoop.tmp.dir in system properties and HBase conf 2023-11-11 11:53:15,901 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/hadoop.log.dir in system properties and HBase conf 2023-11-11 11:53:15,901 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-11 11:53:15,902 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-11 11:53:15,902 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-11 11:53:16,040 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-11 11:53:16,446 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-11 11:53:16,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-11 11:53:16,453 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-11 11:53:16,453 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-11 11:53:16,454 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-11 11:53:16,454 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-11 11:53:16,455 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-11 11:53:16,455 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-11 11:53:16,456 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-11 11:53:16,456 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-11 11:53:16,456 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/nfs.dump.dir in system properties and HBase conf 2023-11-11 11:53:16,457 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/java.io.tmpdir in system properties and HBase conf 2023-11-11 11:53:16,457 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-11 11:53:16,458 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-11 11:53:16,458 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-11 11:53:17,090 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-11 11:53:17,095 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-11 11:53:17,399 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-11 11:53:17,578 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-11 11:53:17,598 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-11 11:53:17,637 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-11 11:53:17,671 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/java.io.tmpdir/Jetty_localhost_42863_hdfs____.dz31y7/webapp 2023-11-11 11:53:17,812 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42863 2023-11-11 11:53:17,822 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-11 11:53:17,822 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-11 11:53:18,398 WARN [Listener at localhost/42537] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-11 11:53:18,481 WARN [Listener at localhost/42537] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-11 11:53:18,499 WARN [Listener at localhost/42537] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-11 11:53:18,507 INFO [Listener at localhost/42537] log.Slf4jLog(67): jetty-6.1.26 2023-11-11 11:53:18,515 INFO [Listener at localhost/42537] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/java.io.tmpdir/Jetty_localhost_44459_datanode____.6dq18h/webapp 2023-11-11 11:53:18,616 INFO [Listener at localhost/42537] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44459 2023-11-11 11:53:19,003 WARN [Listener at localhost/39241] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-11 11:53:19,539 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd3296beceef7fdeb: Processing first storage report for DS-56f068ef-b969-48fd-8f01-cd85bc256e47 from datanode 62de3f35-260d-457c-b3c8-4bf3953a5c73 2023-11-11 11:53:19,541 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd3296beceef7fdeb: from storage DS-56f068ef-b969-48fd-8f01-cd85bc256e47 node DatanodeRegistration(127.0.0.1:41147, datanodeUuid=62de3f35-260d-457c-b3c8-4bf3953a5c73, infoPort=41997, infoSecurePort=0, ipcPort=39241, storageInfo=lv=-57;cid=testClusterID;nsid=1601805763;c=1699703597170), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-11-11 11:53:19,541 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd3296beceef7fdeb: Processing first storage report for DS-51edafa8-53cd-4f59-8a67-13cc4883125e from datanode 62de3f35-260d-457c-b3c8-4bf3953a5c73 2023-11-11 11:53:19,542 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd3296beceef7fdeb: from storage DS-51edafa8-53cd-4f59-8a67-13cc4883125e node DatanodeRegistration(127.0.0.1:41147, datanodeUuid=62de3f35-260d-457c-b3c8-4bf3953a5c73, infoPort=41997, infoSecurePort=0, ipcPort=39241, storageInfo=lv=-57;cid=testClusterID;nsid=1601805763;c=1699703597170), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-11 11:53:19,624 DEBUG [Listener at localhost/39241] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884 2023-11-11 11:53:19,739 INFO [Listener at localhost/39241] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/cluster_ba247ec2-1551-003a-d119-7315b0da3078/zookeeper_0, clientPort=59344, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/cluster_ba247ec2-1551-003a-d119-7315b0da3078/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/cluster_ba247ec2-1551-003a-d119-7315b0da3078/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-11 11:53:19,753 INFO [Listener at localhost/39241] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59344 2023-11-11 11:53:19,760 INFO [Listener at localhost/39241] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 11:53:19,762 INFO [Listener at localhost/39241] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 11:53:20,467 INFO [Listener at localhost/39241] util.FSUtils(471): Created version file at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f with version=8 2023-11-11 11:53:20,468 INFO [Listener at localhost/39241] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/hbase-staging 2023-11-11 11:53:20,762 INFO [Listener at localhost/39241] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-11 11:53:21,210 INFO [Listener at localhost/39241] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-11 11:53:21,242 INFO [Listener at localhost/39241] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-11 11:53:21,242 INFO [Listener at localhost/39241] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-11 11:53:21,243 INFO [Listener at localhost/39241] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-11 11:53:21,243 INFO [Listener at localhost/39241] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-11 11:53:21,243 INFO [Listener at localhost/39241] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-11 11:53:21,412 INFO [Listener at localhost/39241] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-11 11:53:21,483 DEBUG [Listener at localhost/39241] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-11 11:53:21,586 INFO [Listener at localhost/39241] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41929 2023-11-11 11:53:21,596 INFO [Listener at localhost/39241] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 11:53:21,598 INFO [Listener at localhost/39241] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 11:53:21,623 INFO [Listener at localhost/39241] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41929 connecting to ZooKeeper ensemble=127.0.0.1:59344 2023-11-11 11:53:21,665 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:419290x0, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-11 11:53:21,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41929-0x101d4f9ea0a0000 connected 2023-11-11 11:53:21,701 DEBUG [Listener at localhost/39241] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-11 11:53:21,703 DEBUG [Listener at localhost/39241] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-11 11:53:21,706 DEBUG [Listener at localhost/39241] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-11 11:53:21,714 DEBUG [Listener at localhost/39241] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41929 2023-11-11 11:53:21,714 DEBUG [Listener at localhost/39241] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41929 2023-11-11 11:53:21,714 DEBUG [Listener at localhost/39241] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41929 2023-11-11 11:53:21,716 DEBUG [Listener at localhost/39241] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41929 2023-11-11 11:53:21,717 DEBUG [Listener at localhost/39241] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41929 2023-11-11 11:53:21,723 INFO [Listener at localhost/39241] master.HMaster(444): hbase.rootdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f, hbase.cluster.distributed=false 2023-11-11 11:53:21,802 INFO [Listener at localhost/39241] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-11 11:53:21,802 INFO [Listener at localhost/39241] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-11 11:53:21,802 INFO [Listener at localhost/39241] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-11 11:53:21,802 INFO [Listener at localhost/39241] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-11 11:53:21,802 INFO [Listener at localhost/39241] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-11 11:53:21,802 INFO [Listener at localhost/39241] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-11 11:53:21,807 INFO [Listener at localhost/39241] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-11 11:53:21,810 INFO [Listener at localhost/39241] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41363 2023-11-11 11:53:21,812 INFO [Listener at localhost/39241] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-11 11:53:21,818 DEBUG [Listener at localhost/39241] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-11 11:53:21,819 INFO [Listener at localhost/39241] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 11:53:21,821 INFO [Listener at localhost/39241] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 11:53:21,824 INFO [Listener at localhost/39241] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41363 connecting to ZooKeeper ensemble=127.0.0.1:59344 2023-11-11 11:53:21,827 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:413630x0, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-11 11:53:21,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41363-0x101d4f9ea0a0001 connected 2023-11-11 11:53:21,829 DEBUG [Listener at localhost/39241] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-11 11:53:21,830 DEBUG [Listener at localhost/39241] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-11 11:53:21,831 DEBUG [Listener at localhost/39241] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-11 11:53:21,832 DEBUG [Listener at localhost/39241] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41363 2023-11-11 11:53:21,832 DEBUG [Listener at localhost/39241] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41363 2023-11-11 11:53:21,832 DEBUG [Listener at localhost/39241] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41363 2023-11-11 11:53:21,837 DEBUG [Listener at localhost/39241] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41363 2023-11-11 11:53:21,837 DEBUG [Listener at localhost/39241] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41363 2023-11-11 11:53:21,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41929,1699703600606 2023-11-11 11:53:21,848 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-11 11:53:21,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41929,1699703600606 2023-11-11 11:53:21,869 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-11 11:53:21,870 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-11 11:53:21,870 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 11:53:21,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-11 11:53:21,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-11 11:53:21,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41929,1699703600606 from backup master directory 2023-11-11 11:53:21,875 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41929,1699703600606 2023-11-11 11:53:21,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-11 11:53:21,876 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-11 11:53:21,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41929,1699703600606 2023-11-11 11:53:21,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-11 11:53:21,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-11 11:53:21,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/hbase.id with ID: fb882086-d69b-4213-9023-bc04e831a15a 2023-11-11 11:53:22,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 11:53:22,029 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 11:53:22,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x38950243 to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:53:22,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29f5f117, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:53:22,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-11 11:53:22,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-11 11:53:22,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-11 11:53:22,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-11 11:53:22,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-11 11:53:22,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-11 11:53:22,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-11 11:53:22,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/MasterData/data/master/store-tmp 2023-11-11 11:53:22,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:53:22,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-11 11:53:22,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 11:53:22,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 11:53:22,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-11 11:53:22,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 11:53:22,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 11:53:22,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-11 11:53:22,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/MasterData/WALs/jenkins-hbase4.apache.org,41929,1699703600606 2023-11-11 11:53:22,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41929%2C1699703600606, suffix=, logDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/MasterData/WALs/jenkins-hbase4.apache.org,41929,1699703600606, archiveDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/MasterData/oldWALs, maxLogs=10 2023-11-11 11:53:22,306 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41147,DS-56f068ef-b969-48fd-8f01-cd85bc256e47,DISK] 2023-11-11 11:53:22,315 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-11 11:53:22,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/MasterData/WALs/jenkins-hbase4.apache.org,41929,1699703600606/jenkins-hbase4.apache.org%2C41929%2C1699703600606.1699703602255 2023-11-11 11:53:22,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41147,DS-56f068ef-b969-48fd-8f01-cd85bc256e47,DISK]] 2023-11-11 11:53:22,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:53:22,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:53:22,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-11 11:53:22,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-11 11:53:22,455 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-11 11:53:22,462 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-11 11:53:22,489 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-11 11:53:22,504 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:53:22,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-11 11:53:22,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-11 11:53:22,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-11 11:53:22,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:53:22,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66974200, jitterRate=-0.0020066499710083008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:53:22,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-11 11:53:22,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-11 11:53:22,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-11 11:53:22,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-11 11:53:22,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-11 11:53:22,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-11 11:53:22,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-11-11 11:53:22,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-11 11:53:22,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-11 11:53:22,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-11 11:53:22,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-11 11:53:22,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-11 11:53:22,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-11 11:53:22,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-11 11:53:22,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-11 11:53:22,680 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 11:53:22,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-11 11:53:22,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-11 11:53:22,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-11 11:53:22,703 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-11 11:53:22,704 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-11 11:53:22,704 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 11:53:22,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41929,1699703600606, sessionid=0x101d4f9ea0a0000, setting cluster-up flag (Was=false) 2023-11-11 11:53:22,725 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 11:53:22,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-11 11:53:22,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41929,1699703600606 2023-11-11 11:53:22,739 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 11:53:22,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-11 11:53:22,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41929,1699703600606 2023-11-11 11:53:22,750 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot/.tmp 2023-11-11 11:53:22,842 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(951): ClusterId : fb882086-d69b-4213-9023-bc04e831a15a 2023-11-11 11:53:22,848 DEBUG [RS:0;jenkins-hbase4:41363] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-11 11:53:22,857 DEBUG [RS:0;jenkins-hbase4:41363] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-11 11:53:22,857 DEBUG [RS:0;jenkins-hbase4:41363] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-11 11:53:22,863 DEBUG [RS:0;jenkins-hbase4:41363] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-11 11:53:22,866 DEBUG [RS:0;jenkins-hbase4:41363] zookeeper.ReadOnlyZKClient(139): Connect 0x1a1f7a9c to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:53:22,878 DEBUG [RS:0;jenkins-hbase4:41363] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14d887af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:53:22,879 DEBUG [RS:0;jenkins-hbase4:41363] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10e711ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-11 11:53:22,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-11 11:53:22,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-11 11:53:22,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-11 11:53:22,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-11 11:53:22,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-11 11:53:22,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-11 11:53:22,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 11:53:22,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-11 11:53:22,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 11:53:22,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1699703632906 2023-11-11 11:53:22,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-11 11:53:22,910 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-11 11:53:22,910 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-11 11:53:22,911 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41363 2023-11-11 11:53:22,916 INFO [RS:0;jenkins-hbase4:41363] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-11 11:53:22,916 INFO [RS:0;jenkins-hbase4:41363] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-11 11:53:22,916 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-11 11:53:22,916 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1022): About to register with Master. 2023-11-11 11:53:22,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-11 11:53:22,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-11 11:53:22,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-11 11:53:22,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-11 11:53:22,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-11 11:53:22,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:22,936 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41929,1699703600606 with isa=jenkins-hbase4.apache.org/172.31.14.131:41363, startcode=1699703601801 2023-11-11 11:53:22,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-11 11:53:22,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-11 11:53:22,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-11 11:53:22,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-11 11:53:22,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-11 11:53:22,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1699703602948,5,FailOnTimeoutGroup] 2023-11-11 11:53:22,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1699703602951,5,FailOnTimeoutGroup] 2023-11-11 11:53:22,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:22,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-11 11:53:22,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:22,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:22,964 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-11 11:53:22,965 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-11 11:53:22,965 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f 2023-11-11 11:53:22,968 DEBUG [RS:0;jenkins-hbase4:41363] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-11 11:53:22,986 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:53:22,989 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-11 11:53:22,992 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/info 2023-11-11 11:53:22,994 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-11 11:53:22,995 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:53:22,995 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-11 11:53:22,999 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/rep_barrier 2023-11-11 11:53:23,000 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-11 11:53:23,001 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:53:23,001 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-11 11:53:23,003 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/table 2023-11-11 11:53:23,004 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-11 11:53:23,005 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:53:23,007 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740 2023-11-11 11:53:23,008 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740 2023-11-11 11:53:23,013 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-11 11:53:23,016 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-11 11:53:23,023 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:53:23,025 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60253730, jitterRate=-0.10214945673942566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-11 11:53:23,025 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-11 11:53:23,026 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-11 11:53:23,026 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-11 11:53:23,026 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-11 11:53:23,026 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-11 11:53:23,026 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-11 11:53:23,027 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-11 11:53:23,027 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-11 11:53:23,027 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49853, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-11 11:53:23,033 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-11 11:53:23,033 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-11 11:53:23,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-11 11:53:23,043 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41929] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:23,054 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-11 11:53:23,057 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-11 11:53:23,061 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f 2023-11-11 11:53:23,061 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42537 2023-11-11 11:53:23,061 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-11 11:53:23,066 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-11 11:53:23,067 DEBUG [RS:0;jenkins-hbase4:41363] zookeeper.ZKUtil(162): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:23,067 WARN [RS:0;jenkins-hbase4:41363] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-11 11:53:23,067 INFO [RS:0;jenkins-hbase4:41363] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-11 11:53:23,068 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/WALs/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:23,068 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41363,1699703601801] 2023-11-11 11:53:23,077 DEBUG [RS:0;jenkins-hbase4:41363] zookeeper.ZKUtil(162): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:23,090 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-11 11:53:23,101 INFO [RS:0;jenkins-hbase4:41363] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-11 11:53:23,121 INFO [RS:0;jenkins-hbase4:41363] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-11 11:53:23,125 INFO [RS:0;jenkins-hbase4:41363] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:53:23,125 INFO [RS:0;jenkins-hbase4:41363] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:23,126 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-11 11:53:23,132 INFO [RS:0;jenkins-hbase4:41363] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-11 11:53:23,133 DEBUG [RS:0;jenkins-hbase4:41363] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 11:53:23,133 DEBUG [RS:0;jenkins-hbase4:41363] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 11:53:23,133 DEBUG [RS:0;jenkins-hbase4:41363] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 11:53:23,134 DEBUG [RS:0;jenkins-hbase4:41363] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 11:53:23,134 DEBUG [RS:0;jenkins-hbase4:41363] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 11:53:23,134 DEBUG [RS:0;jenkins-hbase4:41363] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-11 11:53:23,134 DEBUG [RS:0;jenkins-hbase4:41363] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 11:53:23,134 DEBUG [RS:0;jenkins-hbase4:41363] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 11:53:23,134 DEBUG [RS:0;jenkins-hbase4:41363] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 11:53:23,134 DEBUG [RS:0;jenkins-hbase4:41363] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-11 11:53:23,135 INFO [RS:0;jenkins-hbase4:41363] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:23,135 INFO [RS:0;jenkins-hbase4:41363] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:23,136 INFO [RS:0;jenkins-hbase4:41363] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:23,152 INFO [RS:0;jenkins-hbase4:41363] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-11 11:53:23,155 INFO [RS:0;jenkins-hbase4:41363] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41363,1699703601801-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:23,172 INFO [RS:0;jenkins-hbase4:41363] regionserver.Replication(203): jenkins-hbase4.apache.org,41363,1699703601801 started 2023-11-11 11:53:23,172 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41363,1699703601801, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41363, sessionid=0x101d4f9ea0a0001 2023-11-11 11:53:23,172 DEBUG [RS:0;jenkins-hbase4:41363] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-11 11:53:23,172 DEBUG [RS:0;jenkins-hbase4:41363] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:23,172 DEBUG [RS:0;jenkins-hbase4:41363] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41363,1699703601801' 2023-11-11 11:53:23,172 DEBUG [RS:0;jenkins-hbase4:41363] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:23,173 DEBUG [RS:0;jenkins-hbase4:41363] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:23,174 DEBUG [RS:0;jenkins-hbase4:41363] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-11 11:53:23,174 DEBUG [RS:0;jenkins-hbase4:41363] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-11 11:53:23,174 DEBUG [RS:0;jenkins-hbase4:41363] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:23,174 DEBUG [RS:0;jenkins-hbase4:41363] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41363,1699703601801' 2023-11-11 11:53:23,174 DEBUG [RS:0;jenkins-hbase4:41363] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-11 11:53:23,174 DEBUG [RS:0;jenkins-hbase4:41363] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-11 11:53:23,175 DEBUG [RS:0;jenkins-hbase4:41363] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-11 11:53:23,175 INFO [RS:0;jenkins-hbase4:41363] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-11 11:53:23,175 INFO [RS:0;jenkins-hbase4:41363] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-11 11:53:23,209 DEBUG [jenkins-hbase4:41929] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-11 11:53:23,212 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41363,1699703601801, state=OPENING 2023-11-11 11:53:23,223 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-11 11:53:23,224 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 11:53:23,225 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-11 11:53:23,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:53:23,290 INFO [RS:0;jenkins-hbase4:41363] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41363%2C1699703601801, suffix=, logDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/WALs/jenkins-hbase4.apache.org,41363,1699703601801, archiveDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/oldWALs, maxLogs=32 2023-11-11 11:53:23,311 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41147,DS-56f068ef-b969-48fd-8f01-cd85bc256e47,DISK] 2023-11-11 11:53:23,315 INFO [RS:0;jenkins-hbase4:41363] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/WALs/jenkins-hbase4.apache.org,41363,1699703601801/jenkins-hbase4.apache.org%2C41363%2C1699703601801.1699703603294 2023-11-11 11:53:23,316 DEBUG [RS:0;jenkins-hbase4:41363] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41147,DS-56f068ef-b969-48fd-8f01-cd85bc256e47,DISK]] 2023-11-11 11:53:23,422 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:23,425 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-11 11:53:23,429 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-11 11:53:23,445 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-11 11:53:23,445 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-11 11:53:23,451 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41363%2C1699703601801.meta, suffix=.meta, logDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/WALs/jenkins-hbase4.apache.org,41363,1699703601801, archiveDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/oldWALs, maxLogs=32 2023-11-11 11:53:23,472 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41147,DS-56f068ef-b969-48fd-8f01-cd85bc256e47,DISK] 2023-11-11 11:53:23,476 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/WALs/jenkins-hbase4.apache.org,41363,1699703601801/jenkins-hbase4.apache.org%2C41363%2C1699703601801.meta.1699703603453.meta 2023-11-11 11:53:23,477 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41147,DS-56f068ef-b969-48fd-8f01-cd85bc256e47,DISK]] 2023-11-11 11:53:23,478 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:53:23,480 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-11 11:53:23,501 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-11 11:53:23,506 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-11 11:53:23,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-11 11:53:23,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:53:23,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-11 11:53:23,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-11 11:53:23,515 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-11 11:53:23,517 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/info 2023-11-11 11:53:23,518 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/info 2023-11-11 11:53:23,518 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-11 11:53:23,519 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:53:23,520 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-11 11:53:23,521 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/rep_barrier 2023-11-11 11:53:23,521 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/rep_barrier 2023-11-11 11:53:23,522 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-11 11:53:23,523 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:53:23,523 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-11 11:53:23,525 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/table 2023-11-11 11:53:23,525 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/table 2023-11-11 11:53:23,525 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-11 11:53:23,526 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:53:23,528 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740 2023-11-11 11:53:23,531 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740 2023-11-11 11:53:23,535 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-11 11:53:23,537 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-11 11:53:23,539 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70350076, jitterRate=0.04829782247543335}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-11 11:53:23,539 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-11 11:53:23,551 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1699703603413 2023-11-11 11:53:23,570 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-11 11:53:23,571 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-11 11:53:23,571 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41363,1699703601801, state=OPEN 2023-11-11 11:53:23,582 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-11 11:53:23,582 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-11 11:53:23,587 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-11 11:53:23,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41363,1699703601801 in 353 msec 2023-11-11 11:53:23,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-11 11:53:23,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 548 msec 2023-11-11 11:53:23,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 795 msec 2023-11-11 11:53:23,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1699703603601, completionTime=-1 2023-11-11 11:53:23,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-11 11:53:23,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-11 11:53:23,676 DEBUG [hconnection-0x67172ff9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:53:23,679 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:53:23,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-11 11:53:23,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1699703663697 2023-11-11 11:53:23,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1699703723697 2023-11-11 11:53:23,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 95 msec 2023-11-11 11:53:23,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41929,1699703600606-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:23,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41929,1699703600606-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:23,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41929,1699703600606-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:23,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41929, period=300000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:23,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-11 11:53:23,739 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-11 11:53:23,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-11 11:53:23,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-11 11:53:23,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-11 11:53:23,763 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 11:53:23,766 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 11:53:23,788 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/hbase/namespace/5d9c8b45df92320cf0682076380e93a0 2023-11-11 11:53:23,791 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/hbase/namespace/5d9c8b45df92320cf0682076380e93a0 empty. 2023-11-11 11:53:23,791 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/hbase/namespace/5d9c8b45df92320cf0682076380e93a0 2023-11-11 11:53:23,792 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-11 11:53:24,213 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-11 11:53:24,215 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5d9c8b45df92320cf0682076380e93a0, NAME => 'hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:53:24,228 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:53:24,229 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 5d9c8b45df92320cf0682076380e93a0, disabling compactions & flushes 2023-11-11 11:53:24,229 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. 2023-11-11 11:53:24,229 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. 2023-11-11 11:53:24,229 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. after waiting 0 ms 2023-11-11 11:53:24,229 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. 2023-11-11 11:53:24,229 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. 2023-11-11 11:53:24,229 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 5d9c8b45df92320cf0682076380e93a0: 2023-11-11 11:53:24,233 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 11:53:24,249 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699703604237"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703604237"}]},"ts":"1699703604237"} 2023-11-11 11:53:24,275 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 11:53:24,277 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 11:53:24,282 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703604277"}]},"ts":"1699703604277"} 2023-11-11 11:53:24,286 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-11 11:53:24,293 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5d9c8b45df92320cf0682076380e93a0, ASSIGN}] 2023-11-11 11:53:24,295 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5d9c8b45df92320cf0682076380e93a0, ASSIGN 2023-11-11 11:53:24,297 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5d9c8b45df92320cf0682076380e93a0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:53:24,448 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5d9c8b45df92320cf0682076380e93a0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:24,448 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699703604448"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703604448"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703604448"}]},"ts":"1699703604448"} 2023-11-11 11:53:24,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5d9c8b45df92320cf0682076380e93a0, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:53:24,606 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:24,612 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. 2023-11-11 11:53:24,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5d9c8b45df92320cf0682076380e93a0, NAME => 'hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:53:24,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5d9c8b45df92320cf0682076380e93a0 2023-11-11 11:53:24,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:53:24,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5d9c8b45df92320cf0682076380e93a0 2023-11-11 11:53:24,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5d9c8b45df92320cf0682076380e93a0 2023-11-11 11:53:24,616 INFO [StoreOpener-5d9c8b45df92320cf0682076380e93a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5d9c8b45df92320cf0682076380e93a0 2023-11-11 11:53:24,618 DEBUG [StoreOpener-5d9c8b45df92320cf0682076380e93a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/namespace/5d9c8b45df92320cf0682076380e93a0/info 2023-11-11 11:53:24,618 DEBUG [StoreOpener-5d9c8b45df92320cf0682076380e93a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/namespace/5d9c8b45df92320cf0682076380e93a0/info 2023-11-11 11:53:24,619 INFO [StoreOpener-5d9c8b45df92320cf0682076380e93a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d9c8b45df92320cf0682076380e93a0 columnFamilyName info 2023-11-11 11:53:24,620 INFO [StoreOpener-5d9c8b45df92320cf0682076380e93a0-1] regionserver.HStore(310): Store=5d9c8b45df92320cf0682076380e93a0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:53:24,622 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/namespace/5d9c8b45df92320cf0682076380e93a0 2023-11-11 11:53:24,622 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/namespace/5d9c8b45df92320cf0682076380e93a0 2023-11-11 11:53:24,627 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5d9c8b45df92320cf0682076380e93a0 2023-11-11 11:53:24,630 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/namespace/5d9c8b45df92320cf0682076380e93a0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:53:24,631 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5d9c8b45df92320cf0682076380e93a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59949532, jitterRate=-0.10668236017227173}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:53:24,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5d9c8b45df92320cf0682076380e93a0: 2023-11-11 11:53:24,633 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0., pid=6, masterSystemTime=1699703604606 2023-11-11 11:53:24,636 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. 2023-11-11 11:53:24,636 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. 2023-11-11 11:53:24,638 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5d9c8b45df92320cf0682076380e93a0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:24,638 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699703604637"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703604637"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703604637"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703604637"}]},"ts":"1699703604637"} 2023-11-11 11:53:24,646 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-11 11:53:24,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5d9c8b45df92320cf0682076380e93a0, server=jenkins-hbase4.apache.org,41363,1699703601801 in 190 msec 2023-11-11 11:53:24,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-11 11:53:24,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5d9c8b45df92320cf0682076380e93a0, ASSIGN in 353 msec 2023-11-11 11:53:24,651 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 11:53:24,652 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703604651"}]},"ts":"1699703604651"} 2023-11-11 11:53:24,654 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-11 11:53:24,658 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 11:53:24,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 907 msec 2023-11-11 11:53:24,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-11 11:53:24,665 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-11 11:53:24,666 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 11:53:24,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-11 11:53:24,713 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-11 11:53:24,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-11-11 11:53:24,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-11 11:53:24,748 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-11 11:53:24,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-11-11 11:53:24,773 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-11 11:53:24,775 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-11 11:53:24,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.899sec 2023-11-11 11:53:24,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-11 11:53:24,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-11 11:53:24,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-11 11:53:24,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41929,1699703600606-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-11 11:53:24,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41929,1699703600606-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-11 11:53:24,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-11 11:53:24,850 DEBUG [Listener at localhost/39241] zookeeper.ReadOnlyZKClient(139): Connect 0x36d9c5a6 to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:53:24,855 DEBUG [Listener at localhost/39241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35f0769d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:53:24,873 DEBUG [hconnection-0x5c51df4d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:53:24,886 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:53:24,901 INFO [Listener at localhost/39241] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41929,1699703600606 2023-11-11 11:53:24,903 DEBUG [Listener at localhost/39241] zookeeper.ReadOnlyZKClient(139): Connect 0x65c25ebc to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:53:24,914 DEBUG [Listener at localhost/39241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@517aa6c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:53:24,914 INFO [Listener at localhost/39241] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 11:53:24,970 INFO [Listener at localhost/39241] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=213, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=170, AvailableMemoryMB=2863 2023-11-11 11:53:24,982 DEBUG [Listener at localhost/39241] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:53:24,986 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:53:25,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-11 11:53:25,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:25,005 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 11:53:25,007 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 11:53:25,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-11 11:53:25,009 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:25,011 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166 empty. 2023-11-11 11:53:25,012 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:25,012 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-11 11:53:25,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-11 11:53:25,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-11 11:53:25,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-11 11:53:25,431 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-11 11:53:25,433 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => db6a44e3220a0eac47241b7eccc20166, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:53:25,445 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:53:25,445 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing db6a44e3220a0eac47241b7eccc20166, disabling compactions & flushes 2023-11-11 11:53:25,445 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:25,445 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:25,445 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. after waiting 0 ms 2023-11-11 11:53:25,445 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:25,445 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:25,445 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:25,449 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 11:53:25,451 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699703605451"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703605451"}]},"ts":"1699703605451"} 2023-11-11 11:53:25,454 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 11:53:25,455 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 11:53:25,456 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703605455"}]},"ts":"1699703605455"} 2023-11-11 11:53:25,458 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-11 11:53:25,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=db6a44e3220a0eac47241b7eccc20166, ASSIGN}] 2023-11-11 11:53:25,464 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=db6a44e3220a0eac47241b7eccc20166, ASSIGN 2023-11-11 11:53:25,466 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=db6a44e3220a0eac47241b7eccc20166, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:53:25,617 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=db6a44e3220a0eac47241b7eccc20166, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:25,618 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699703605617"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703605617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703605617"}]},"ts":"1699703605617"} 2023-11-11 11:53:25,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure db6a44e3220a0eac47241b7eccc20166, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:53:25,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-11 11:53:25,775 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:25,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:25,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db6a44e3220a0eac47241b7eccc20166, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:53:25,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:25,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:53:25,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:25,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:25,786 INFO [StoreOpener-db6a44e3220a0eac47241b7eccc20166-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:25,789 DEBUG [StoreOpener-db6a44e3220a0eac47241b7eccc20166-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1 2023-11-11 11:53:25,789 DEBUG [StoreOpener-db6a44e3220a0eac47241b7eccc20166-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1 2023-11-11 11:53:25,792 INFO [StoreOpener-db6a44e3220a0eac47241b7eccc20166-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db6a44e3220a0eac47241b7eccc20166 columnFamilyName family1 2023-11-11 11:53:25,795 INFO [StoreOpener-db6a44e3220a0eac47241b7eccc20166-1] regionserver.HStore(310): Store=db6a44e3220a0eac47241b7eccc20166/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:53:25,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:25,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:25,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:25,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:53:25,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened db6a44e3220a0eac47241b7eccc20166; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68226750, jitterRate=0.01665779948234558}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:53:25,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:25,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166., pid=11, masterSystemTime=1699703605775 2023-11-11 11:53:25,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:25,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:25,817 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=db6a44e3220a0eac47241b7eccc20166, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:25,818 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699703605817"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703605817"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703605817"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703605817"}]},"ts":"1699703605817"} 2023-11-11 11:53:25,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-11 11:53:25,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure db6a44e3220a0eac47241b7eccc20166, server=jenkins-hbase4.apache.org,41363,1699703601801 in 200 msec 2023-11-11 11:53:25,828 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-11 11:53:25,829 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=db6a44e3220a0eac47241b7eccc20166, ASSIGN in 363 msec 2023-11-11 11:53:25,830 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 11:53:25,830 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703605830"}]},"ts":"1699703605830"} 2023-11-11 11:53:25,833 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-11 11:53:25,838 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 11:53:25,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 837 msec 2023-11-11 11:53:26,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-11 11:53:26,131 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-11 11:53:26,148 DEBUG [hconnection-0x1ddb479a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:53:26,152 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:53:26,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:26,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,306 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:26,306 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:26,307 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 11:53:26,307 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 11:53:26,308 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,308 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,310 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:26,310 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:26,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:26,310 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,311 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:26,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:26,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,313 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,315 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 11:53:26,315 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:26,316 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 11:53:26,317 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:26,317 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:26,317 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:26,318 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. started... 2023-11-11 11:53:26,319 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db6a44e3220a0eac47241b7eccc20166 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 11:53:26,492 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d3cc4ef0cbef4b0da697962c4a75b7a1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130d3cc4ef0cbef4b0da697962c4a75b7a1 2023-11-11 11:53:26,910 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/21b15d5e266a49518533d957cb398861 2023-11-11 11:53:26,922 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/21b15d5e266a49518533d957cb398861 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/21b15d5e266a49518533d957cb398861 2023-11-11 11:53:26,934 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/21b15d5e266a49518533d957cb398861, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-11 11:53:26,937 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for db6a44e3220a0eac47241b7eccc20166 in 618ms, sequenceid=5, compaction requested=false 2023-11-11 11:53:26,939 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:26,942 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:26,942 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:26,942 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:26,942 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:26,942 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,942 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 11:53:26,942 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 11:53:26,946 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,946 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:26,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:26,946 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,946 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:26,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:26,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:26,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 11:53:26,949 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 11:53:26,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4098e1ec[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:26,949 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,951 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,951 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 11:53:26,951 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 11:53:26,951 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,951 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:26,951 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:26,956 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 11:53:26,956 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,956 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:26,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:26,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:26,956 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 11:53:26,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:26,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:26,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:26,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:26,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 11:53:26,960 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 11:53:26,960 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:26,960 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:26,960 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,960 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:26,963 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,963 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:26,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:26,963 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:26,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:26,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:26,964 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:26,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,966 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:26,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,973 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,974 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,974 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,974 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:26,974 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:26,974 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,974 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,974 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:26,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:26,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:26,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:26,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:26,974 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:26,974 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:26,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:26,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:26,977 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:26,977 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:27,077 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:27,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:27,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:27,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:27,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,098 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:27,098 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:27,099 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 11:53:27,099 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 11:53:27,100 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,100 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,109 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:27,109 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:27,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:27,110 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,110 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:27,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:27,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,111 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,111 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 11:53:27,111 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,111 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 11:53:27,111 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:27,112 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 11:53:27,112 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:27,112 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:27,112 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:27,112 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. started... 2023-11-11 11:53:27,113 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db6a44e3220a0eac47241b7eccc20166 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 11:53:27,146 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128693588cbd9ca4e509674f1254807e57e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128693588cbd9ca4e509674f1254807e57e 2023-11-11 11:53:27,158 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/b41e035aaf30466884c33bc49e690b8d 2023-11-11 11:53:27,169 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/b41e035aaf30466884c33bc49e690b8d as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/b41e035aaf30466884c33bc49e690b8d 2023-11-11 11:53:27,178 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/b41e035aaf30466884c33bc49e690b8d, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 11:53:27,180 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for db6a44e3220a0eac47241b7eccc20166 in 67ms, sequenceid=9, compaction requested=false 2023-11-11 11:53:27,180 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:27,180 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:27,180 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:27,181 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:27,181 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,181 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 11:53:27,181 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 11:53:27,184 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,184 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:27,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:27,185 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,185 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:27,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:27,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:27,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 11:53:27,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@128727cb[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:27,188 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 11:53:27,189 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,190 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,190 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 11:53:27,190 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 11:53:27,190 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:27,191 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,191 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:27,194 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 11:53:27,194 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,194 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:27,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:27,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:27,194 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 11:53:27,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:27,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:27,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:27,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 11:53:27,198 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 11:53:27,198 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:27,198 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:27,198 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,198 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:27,200 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,200 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:27,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:27,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,200 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:27,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:27,201 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:27,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:27,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,203 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,207 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,207 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,207 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,207 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:27,207 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,207 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:27,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:27,208 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:27,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-11 11:53:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:27,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:27,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:27,207 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,208 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,208 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:27,209 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:27,209 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:27,309 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:27,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:27,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:27,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:27,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,322 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:27,322 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:27,322 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 11:53:27,322 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 11:53:27,323 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,323 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,325 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:27,325 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:27,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:27,325 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,325 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:27,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:27,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,327 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,327 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 11:53:27,327 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,327 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 11:53:27,328 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:27,328 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 11:53:27,328 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:27,328 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:27,328 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:27,328 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. started... 2023-11-11 11:53:27,328 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db6a44e3220a0eac47241b7eccc20166 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:27,357 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ed613091264c4124a05ba6d9d490a1a2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201ed613091264c4124a05ba6d9d490a1a2 2023-11-11 11:53:27,770 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/183c6af6f0004b11a8aabcbbbd85b73b 2023-11-11 11:53:27,786 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/183c6af6f0004b11a8aabcbbbd85b73b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/183c6af6f0004b11a8aabcbbbd85b73b 2023-11-11 11:53:27,796 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/183c6af6f0004b11a8aabcbbbd85b73b, entries=1, sequenceid=13, filesize=5.0 K 2023-11-11 11:53:27,797 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db6a44e3220a0eac47241b7eccc20166 in 469ms, sequenceid=13, compaction requested=true 2023-11-11 11:53:27,798 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:27,798 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:27,798 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:27,798 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:27,798 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,798 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 11:53:27,798 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 11:53:27,802 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,803 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:27,803 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,803 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:27,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:27,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:27,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:27,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 11:53:27,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60a8a748[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:27,806 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 11:53:27,806 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,808 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,808 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 11:53:27,808 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 11:53:27,808 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:27,808 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,808 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:27,811 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,811 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 11:53:27,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:27,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:27,811 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:27,812 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 11:53:27,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:27,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:27,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 11:53:27,820 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 11:53:27,820 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:27,821 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:27,821 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,821 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:27,824 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,824 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:27,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,824 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:27,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:27,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:27,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:27,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:27,826 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:27,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,829 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:27,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,836 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,837 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,837 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,837 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:27,837 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:27,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:27,837 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,837 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,837 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,837 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,837 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:27,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:27,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:27,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:27,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:27,838 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:27,839 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:27,939 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:27,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:27,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:27,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:27,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,950 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:27,950 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:27,951 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 11:53:27,951 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 11:53:27,952 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,952 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,953 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:27,953 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:27,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:27,954 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:27,954 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:27,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:27,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,955 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,955 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 11:53:27,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:27,955 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 11:53:27,955 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:27,956 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 11:53:27,956 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:27,956 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:27,956 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:27,956 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. started... 2023-11-11 11:53:27,956 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db6a44e3220a0eac47241b7eccc20166 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:28,381 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e81243dc44a049b9b35ac5c92a58f38e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205e81243dc44a049b9b35ac5c92a58f38e 2023-11-11 11:53:28,793 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/69b9db999a804896bc2e0255d2c9a27d 2023-11-11 11:53:28,811 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/69b9db999a804896bc2e0255d2c9a27d as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/69b9db999a804896bc2e0255d2c9a27d 2023-11-11 11:53:28,827 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/69b9db999a804896bc2e0255d2c9a27d, entries=1, sequenceid=17, filesize=5.0 K 2023-11-11 11:53:28,828 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db6a44e3220a0eac47241b7eccc20166 in 872ms, sequenceid=17, compaction requested=true 2023-11-11 11:53:28,829 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:28,829 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:28,829 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:28,829 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:28,829 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,829 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 11:53:28,829 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 11:53:28,832 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,832 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:28,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:28,833 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,833 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:28,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:28,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:28,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:28,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 11:53:28,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41a2c8a0[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:28,836 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 11:53:28,836 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,837 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,838 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 11:53:28,838 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 11:53:28,838 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:28,838 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,838 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:28,843 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 11:53:28,843 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:28,843 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,843 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 11:53:28,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:28,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:28,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:28,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:28,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:28,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:28,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 11:53:28,854 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 11:53:28,854 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:28,854 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:28,854 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,854 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:28,860 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,860 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:28,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:28,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,860 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:28,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:28,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:28,862 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:28,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:28,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,865 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:28,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:28,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:28,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:28,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:28,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:28,879 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:28,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:28,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:28,880 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:28,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:28,880 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:28,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:28,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-11 11:53:28,981 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:28,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:28,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:28,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:28,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:28,998 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:28,998 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:28,999 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 11:53:28,999 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 11:53:29,000 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,000 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,003 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,003 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:29,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:29,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:29,004 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,004 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:29,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:29,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,006 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,006 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 11:53:29,007 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,007 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 11:53:29,007 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:29,007 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 11:53:29,008 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:29,008 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:29,008 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:29,008 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. started... 2023-11-11 11:53:29,008 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db6a44e3220a0eac47241b7eccc20166 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:29,035 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 11:53:29,060 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a341fec7e39d4242af0d8f00cd77beaf to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228a341fec7e39d4242af0d8f00cd77beaf 2023-11-11 11:53:29,115 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-11 11:53:29,116 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-11 11:53:29,482 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/bc1d78977ee7452e973af7ee59e66023 2023-11-11 11:53:29,492 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/bc1d78977ee7452e973af7ee59e66023 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/bc1d78977ee7452e973af7ee59e66023 2023-11-11 11:53:29,503 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/bc1d78977ee7452e973af7ee59e66023, entries=1, sequenceid=21, filesize=5.0 K 2023-11-11 11:53:29,504 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db6a44e3220a0eac47241b7eccc20166 in 496ms, sequenceid=21, compaction requested=true 2023-11-11 11:53:29,504 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:29,504 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:29,504 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:29,505 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:29,505 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,505 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 11:53:29,505 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 11:53:29,509 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,509 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:29,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:29,509 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,509 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:29,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:29,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:29,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:29,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 11:53:29,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4632c6f9[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:29,512 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 11:53:29,512 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,514 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,514 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 11:53:29,514 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 11:53:29,514 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:29,514 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,514 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:29,516 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 11:53:29,516 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,516 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:29,516 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 11:53:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:29,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 11:53:29,521 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 11:53:29,521 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:29,521 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:29,522 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,522 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:29,524 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:29,525 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,525 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:29,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:29,526 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,530 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,535 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,535 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,536 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:29,536 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:29,536 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:29,536 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:29,536 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:29,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:29,537 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,537 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-11 11:53:29,537 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:29,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:29,538 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:29,538 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:29,638 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:29,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:29,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:29,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:29,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,669 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:29,669 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:29,673 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 11:53:29,673 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 11:53:29,674 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,674 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,676 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,676 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:29,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:29,676 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,676 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,678 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,679 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 11:53:29,680 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,680 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 11:53:29,680 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:29,680 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 11:53:29,681 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:29,681 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:29,681 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:29,681 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. started... 2023-11-11 11:53:29,681 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db6a44e3220a0eac47241b7eccc20166 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:29,705 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312231daf9c74348fab67e1b1a2923db06 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312231daf9c74348fab67e1b1a2923db06 2023-11-11 11:53:29,719 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/305ea77d38544c42871bed5378c77abf 2023-11-11 11:53:29,730 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/305ea77d38544c42871bed5378c77abf as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/305ea77d38544c42871bed5378c77abf 2023-11-11 11:53:29,742 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/305ea77d38544c42871bed5378c77abf, entries=1, sequenceid=25, filesize=5.0 K 2023-11-11 11:53:29,743 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db6a44e3220a0eac47241b7eccc20166 in 62ms, sequenceid=25, compaction requested=true 2023-11-11 11:53:29,743 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:29,743 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:29,743 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:29,744 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:29,744 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,744 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 11:53:29,744 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 11:53:29,746 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,746 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:29,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:29,747 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,747 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:29,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:29,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:29,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:29,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 11:53:29,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d20188b[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:29,750 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 11:53:29,750 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,751 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,751 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 11:53:29,752 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 11:53:29,752 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:29,752 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,752 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:29,755 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 11:53:29,755 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,755 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:29,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,755 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 11:53:29,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:29,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:29,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:29,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:29,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:29,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:29,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 11:53:29,760 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 11:53:29,760 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:29,760 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:29,760 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,760 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:29,762 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,762 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,762 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:29,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:29,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:29,763 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:29,765 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:29,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,769 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,769 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:29,769 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:29,769 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:29,769 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,769 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,769 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:29,769 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,769 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,769 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:29,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-11 11:53:29,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:29,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:29,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:29,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:29,771 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:29,771 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:29,871 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:29,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:29,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:29,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:29,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,883 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:29,883 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:29,883 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 11:53:29,883 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 11:53:29,884 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,884 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,885 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,885 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:29,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:29,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:29,886 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:29,886 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:29,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,887 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,888 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 11:53:29,888 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:29,888 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 11:53:29,888 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:29,888 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 11:53:29,889 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:29,889 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:29,889 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:29,889 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. started... 2023-11-11 11:53:29,889 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db6a44e3220a0eac47241b7eccc20166 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:29,912 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101bb3350060f7c4c168437efeefb692d78 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101bb3350060f7c4c168437efeefb692d78 2023-11-11 11:53:30,323 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/bf0b019e8ff7430bae1df142f0139c44 2023-11-11 11:53:30,332 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/bf0b019e8ff7430bae1df142f0139c44 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/bf0b019e8ff7430bae1df142f0139c44 2023-11-11 11:53:30,345 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/bf0b019e8ff7430bae1df142f0139c44, entries=1, sequenceid=29, filesize=5.0 K 2023-11-11 11:53:30,346 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db6a44e3220a0eac47241b7eccc20166 in 457ms, sequenceid=29, compaction requested=true 2023-11-11 11:53:30,347 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:30,347 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:30,347 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:30,348 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:30,348 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,348 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 11:53:30,348 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 11:53:30,354 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,354 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:30,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:30,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:30,355 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,355 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:30,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:30,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:30,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 11:53:30,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48176080[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:30,358 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 11:53:30,359 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,360 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,360 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 11:53:30,361 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 11:53:30,361 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:30,361 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,361 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:30,363 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 11:53:30,363 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,363 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:30,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:30,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:30,363 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 11:53:30,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:30,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:30,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:30,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 11:53:30,368 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 11:53:30,368 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:30,368 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:30,368 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,368 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:30,370 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,370 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:30,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,370 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:30,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:30,371 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,373 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:30,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,376 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,376 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,376 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,376 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:30,376 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:30,376 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:30,376 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:30,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:30,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:30,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:30,376 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-11 11:53:30,377 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,377 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,377 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:30,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:30,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:30,378 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:30,478 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:30,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:30,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:30,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:30,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,491 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:30,491 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:30,491 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 11:53:30,492 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 11:53:30,492 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,492 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,494 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:30,494 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:30,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:30,494 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:30,495 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:30,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:30,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,496 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,496 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 11:53:30,496 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:30,496 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 11:53:30,497 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:30,497 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 11:53:30,497 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:30,497 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:30,497 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:30,498 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. started... 2023-11-11 11:53:30,498 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db6a44e3220a0eac47241b7eccc20166 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:30,758 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-11 11:53:30,759 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-11 11:53:30,961 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036dd89d77f3744046bcdd7a63d7ffd010 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601036dd89d77f3744046bcdd7a63d7ffd010 2023-11-11 11:53:31,376 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/6f6c61cc71b442b18c8a018ac4dedf1d 2023-11-11 11:53:31,386 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/6f6c61cc71b442b18c8a018ac4dedf1d as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/6f6c61cc71b442b18c8a018ac4dedf1d 2023-11-11 11:53:31,394 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/6f6c61cc71b442b18c8a018ac4dedf1d, entries=1, sequenceid=33, filesize=5.0 K 2023-11-11 11:53:31,395 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db6a44e3220a0eac47241b7eccc20166 in 897ms, sequenceid=33, compaction requested=true 2023-11-11 11:53:31,395 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:31,395 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:31,395 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:31,396 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:31,396 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,396 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 11:53:31,396 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 11:53:31,399 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,399 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:31,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:31,400 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,400 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:31,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:31,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:31,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:31,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 11:53:31,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f2756ea[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:31,403 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 11:53:31,403 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,404 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,404 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 11:53:31,404 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 11:53:31,404 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:31,404 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,404 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:31,406 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 11:53:31,406 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,406 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:31,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,406 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 11:53:31,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:31,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:31,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:31,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:31,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:31,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:31,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 11:53:31,412 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 11:53:31,412 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:31,412 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:31,412 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,412 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:31,414 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,414 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,414 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:31,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:31,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:31,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:31,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:31,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:31,415 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,417 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:31,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:31,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:31,424 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:31,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:31,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:31,425 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,425 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:31,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:31,426 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:31,426 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:31,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-11 11:53:31,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:31,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:31,526 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:31,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:31,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:31,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:31,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,539 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:31,540 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:31,540 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 11:53:31,540 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 11:53:31,540 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,541 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,542 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,542 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:31,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:31,543 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,543 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:31,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,544 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,544 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 11:53:31,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,544 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 11:53:31,544 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:31,545 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 11:53:31,545 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:31,545 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:31,545 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:31,545 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. started... 2023-11-11 11:53:31,545 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db6a44e3220a0eac47241b7eccc20166 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:31,568 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b6e797bab05e4763ad7637d534345938 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907b6e797bab05e4763ad7637d534345938 2023-11-11 11:53:31,583 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/3fd5149faa4e4424ae192a32d0e65a1c 2023-11-11 11:53:31,591 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/3fd5149faa4e4424ae192a32d0e65a1c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/3fd5149faa4e4424ae192a32d0e65a1c 2023-11-11 11:53:31,599 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/3fd5149faa4e4424ae192a32d0e65a1c, entries=1, sequenceid=37, filesize=5.0 K 2023-11-11 11:53:31,600 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db6a44e3220a0eac47241b7eccc20166 in 55ms, sequenceid=37, compaction requested=true 2023-11-11 11:53:31,600 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:31,600 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:31,600 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:31,601 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:31,601 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,601 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 11:53:31,601 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 11:53:31,603 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,604 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:31,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:31,604 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,604 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:31,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:31,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:31,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:31,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 11:53:31,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f725ef9[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:31,607 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 11:53:31,607 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,609 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,609 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 11:53:31,609 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 11:53:31,609 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:31,609 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,609 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:31,612 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 11:53:31,612 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:31,612 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 11:53:31,612 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:31,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:31,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:31,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:31,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:31,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:31,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 11:53:31,617 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 11:53:31,617 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:31,617 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:31,617 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,617 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:31,620 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,620 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:31,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:31,620 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:31,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:31,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:31,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:31,623 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:31,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,638 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:31,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,644 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,644 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,644 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,644 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,644 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,644 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,644 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:31,644 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:31,644 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,644 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:31,644 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-11 11:53:31,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:31,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:31,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:31,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:31,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:31,645 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:31,646 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:31,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:31,746 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:31,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:31,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:31,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:31,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,757 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:31,757 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:31,758 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-11 11:53:31,758 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-11 11:53:31,759 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,759 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,761 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,761 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:31,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:31,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:31,762 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:31,762 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:31,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:31,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,763 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,763 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-11 11:53:31,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:31,764 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-11 11:53:31,764 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:31,765 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-11 11:53:31,765 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:31,765 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:31,765 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:31,765 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. started... 2023-11-11 11:53:31,765 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing db6a44e3220a0eac47241b7eccc20166 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:32,186 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120597daca6549744b9ac1e3d6632442f42 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120597daca6549744b9ac1e3d6632442f42 2023-11-11 11:53:32,595 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/1ad4adaa36584770927fe913de4e9134 2023-11-11 11:53:32,603 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/1ad4adaa36584770927fe913de4e9134 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/1ad4adaa36584770927fe913de4e9134 2023-11-11 11:53:32,610 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/1ad4adaa36584770927fe913de4e9134, entries=1, sequenceid=41, filesize=5.0 K 2023-11-11 11:53:32,611 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for db6a44e3220a0eac47241b7eccc20166 in 846ms, sequenceid=41, compaction requested=true 2023-11-11 11:53:32,611 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:32,611 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:32,612 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:32,612 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:32,612 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,612 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-11 11:53:32,612 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-11 11:53:32,614 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,614 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:32,615 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,615 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:32,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:32,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:32,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:32,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-11 11:53:32,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22fbf3dc[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:32,617 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-11 11:53:32,617 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,618 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,619 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-11 11:53:32,619 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-11 11:53:32,619 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:32,619 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,619 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:32,620 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,620 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-11 11:53:32,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:32,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:32,621 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:32,621 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-11 11:53:32,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:32,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:32,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:32,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:32,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-11 11:53:32,625 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-11 11:53:32,625 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:32,625 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:32,625 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,625 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:32,628 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,628 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:32,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:32,628 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:32,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:32,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:32,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:32,631 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:32,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,632 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:32,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,635 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:32,635 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:32,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:32,635 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,635 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,635 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:32,635 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-11 11:53:32,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-11 11:53:32,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:32,636 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:32,636 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,636 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,636 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:32,636 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:32,638 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:32,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:32,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:32,737 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:32,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:32,743 DEBUG [Listener at localhost/39241] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-11 11:53:32,745 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-11 11:53:32,746 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:32,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-11 11:53:32,760 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-11 11:53:32,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:53:32,761 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704212761 2023-11-11 11:53:32,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 11:53:32,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-11 11:53:32,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 11:53:32,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x20f3b936 to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:53:32,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4199e22d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:53:32,773 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:33,242 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fdb0b4e6f3cc41f49ba193548b7f7b17 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103fdb0b4e6f3cc41f49ba193548b7f7b17 2023-11-11 11:53:33,244 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 11:53:33,263 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:53:33,265 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:53:33,275 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:53:33,277 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:53:33,311 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/75f8c404fef2457dbe4c63884e7864b3 first=Optional[r3] last=Optional[r6] 2023-11-11 11:53:33,325 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/75f8c404fef2457dbe4c63884e7864b3}] 2023-11-11 11:53:33,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/75f8c404fef2457dbe4c63884e7864b3 for inclusion in db6a44e3220a0eac47241b7eccc20166/family1 2023-11-11 11:53:33,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-11 11:53:33,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:53:33,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:33,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/75f8c404fef2457dbe4c63884e7864b3 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v85nfd1qp38ehskprjs1gm6n156es5jlei3cetq6vb2r3b5d8il3cdbt4eaij164/family1/75f8c404fef2457dbe4c63884e7864b3 2023-11-11 11:53:33,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v85nfd1qp38ehskprjs1gm6n156es5jlei3cetq6vb2r3b5d8il3cdbt4eaij164/family1/75f8c404fef2457dbe4c63884e7864b3 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/497bf17c46dd4392ab60ecd57c5dfa66_SeqId_44_ 2023-11-11 11:53:33,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v85nfd1qp38ehskprjs1gm6n156es5jlei3cetq6vb2r3b5d8il3cdbt4eaij164/family1/75f8c404fef2457dbe4c63884e7864b3 into db6a44e3220a0eac47241b7eccc20166/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/497bf17c46dd4392ab60ecd57c5dfa66_SeqId_44_ - updating store file list. 2023-11-11 11:53:33,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/497bf17c46dd4392ab60ecd57c5dfa66_SeqId_44_ into db6a44e3220a0eac47241b7eccc20166/family1 2023-11-11 11:53:33,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v85nfd1qp38ehskprjs1gm6n156es5jlei3cetq6vb2r3b5d8il3cdbt4eaij164/family1/75f8c404fef2457dbe4c63884e7864b3 into db6a44e3220a0eac47241b7eccc20166/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/497bf17c46dd4392ab60ecd57c5dfa66_SeqId_44_) 2023-11-11 11:53:33,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v85nfd1qp38ehskprjs1gm6n156es5jlei3cetq6vb2r3b5d8il3cdbt4eaij164/family1/75f8c404fef2457dbe4c63884e7864b3 2023-11-11 11:53:33,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 11:53:33,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 11:53:33,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(1912): db6a44e3220a0eac47241b7eccc20166/family1 is initiating minor compaction 2023-11-11 11:53:33,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@40cf5b77; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:53:33,378 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of db6a44e3220a0eac47241b7eccc20166/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:33,379 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/b41e035aaf30466884c33bc49e690b8d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/183c6af6f0004b11a8aabcbbbd85b73b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/69b9db999a804896bc2e0255d2c9a27d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/bc1d78977ee7452e973af7ee59e66023, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/305ea77d38544c42871bed5378c77abf, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/bf0b019e8ff7430bae1df142f0139c44, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/6f6c61cc71b442b18c8a018ac4dedf1d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/3fd5149faa4e4424ae192a32d0e65a1c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/1ad4adaa36584770927fe913de4e9134, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/497bf17c46dd4392ab60ecd57c5dfa66_SeqId_44_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp, totalSize=50.2 K 2023-11-11 11:53:33,380 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting b41e035aaf30466884c33bc49e690b8d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 11:53:33,380 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 183c6af6f0004b11a8aabcbbbd85b73b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 11:53:33,380 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 69b9db999a804896bc2e0255d2c9a27d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 11:53:33,380 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting bc1d78977ee7452e973af7ee59e66023, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 11:53:33,380 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 305ea77d38544c42871bed5378c77abf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 11:53:33,380 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting bf0b019e8ff7430bae1df142f0139c44, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 11:53:33,380 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 6f6c61cc71b442b18c8a018ac4dedf1d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 11:53:33,380 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 3fd5149faa4e4424ae192a32d0e65a1c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 11:53:33,380 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 1ad4adaa36584770927fe913de4e9134, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 11:53:33,380 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 497bf17c46dd4392ab60ecd57c5dfa66_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 11:53:33,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 11:53:33,398 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:53:33,404 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228a341fec7e39d4242af0d8f00cd77beaf to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228a341fec7e39d4242af0d8f00cd77beaf 2023-11-11 11:53:33,406 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312231daf9c74348fab67e1b1a2923db06 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312231daf9c74348fab67e1b1a2923db06 2023-11-11 11:53:33,408 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101bb3350060f7c4c168437efeefb692d78 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101bb3350060f7c4c168437efeefb692d78 2023-11-11 11:53:33,409 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601036dd89d77f3744046bcdd7a63d7ffd010 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601036dd89d77f3744046bcdd7a63d7ffd010 2023-11-11 11:53:33,409 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-11 11:53:33,410 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-11 11:53:33,410 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:33,410 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:33,410 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:33,410 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:33,410 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:33,410 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:33,410 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:33,411 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:33,443 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): db6a44e3220a0eac47241b7eccc20166#family1#compaction#10 average throughput is 0.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:53:33,871 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/f821f7e1489747dfb14cfb7f690dedfd as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/f821f7e1489747dfb14cfb7f690dedfd 2023-11-11 11:53:33,886 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in db6a44e3220a0eac47241b7eccc20166/family1 of db6a44e3220a0eac47241b7eccc20166 into f821f7e1489747dfb14cfb7f690dedfd(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:53:33,886 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:33,887 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1699703613376; duration=0sec 2023-11-11 11:53:33,889 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:53:33,945 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/b41e035aaf30466884c33bc49e690b8d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/183c6af6f0004b11a8aabcbbbd85b73b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/69b9db999a804896bc2e0255d2c9a27d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/bc1d78977ee7452e973af7ee59e66023, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/305ea77d38544c42871bed5378c77abf, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/bf0b019e8ff7430bae1df142f0139c44, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/6f6c61cc71b442b18c8a018ac4dedf1d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/3fd5149faa4e4424ae192a32d0e65a1c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/1ad4adaa36584770927fe913de4e9134, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/497bf17c46dd4392ab60ecd57c5dfa66_SeqId_44_] to archive 2023-11-11 11:53:33,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:53:33,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/b41e035aaf30466884c33bc49e690b8d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/b41e035aaf30466884c33bc49e690b8d 2023-11-11 11:53:33,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/183c6af6f0004b11a8aabcbbbd85b73b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/183c6af6f0004b11a8aabcbbbd85b73b 2023-11-11 11:53:33,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/69b9db999a804896bc2e0255d2c9a27d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/69b9db999a804896bc2e0255d2c9a27d 2023-11-11 11:53:33,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/bc1d78977ee7452e973af7ee59e66023 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/bc1d78977ee7452e973af7ee59e66023 2023-11-11 11:53:33,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/305ea77d38544c42871bed5378c77abf to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/305ea77d38544c42871bed5378c77abf 2023-11-11 11:53:33,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/bf0b019e8ff7430bae1df142f0139c44 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/bf0b019e8ff7430bae1df142f0139c44 2023-11-11 11:53:33,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/6f6c61cc71b442b18c8a018ac4dedf1d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/6f6c61cc71b442b18c8a018ac4dedf1d 2023-11-11 11:53:33,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/3fd5149faa4e4424ae192a32d0e65a1c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/3fd5149faa4e4424ae192a32d0e65a1c 2023-11-11 11:53:33,963 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/1ad4adaa36584770927fe913de4e9134 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/1ad4adaa36584770927fe913de4e9134 2023-11-11 11:53:33,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/497bf17c46dd4392ab60ecd57c5dfa66_SeqId_44_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/497bf17c46dd4392ab60ecd57c5dfa66_SeqId_44_ 2023-11-11 11:53:34,300 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120590dbfbda6d184b688fa8a796036480f8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120590dbfbda6d184b688fa8a796036480f8 2023-11-11 11:53:34,303 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 11:53:34,347 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/743552f2e2424412a0f0585568727829 first=Optional[r00] last=Optional[r2] 2023-11-11 11:53:34,348 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/743552f2e2424412a0f0585568727829}] 2023-11-11 11:53:34,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/743552f2e2424412a0f0585568727829 for inclusion in db6a44e3220a0eac47241b7eccc20166/family1 2023-11-11 11:53:34,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-11 11:53:34,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:53:34,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:34,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/743552f2e2424412a0f0585568727829 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s00sveqiid0cnqm62qiktd7rrl2uk8ak2hrspvku061pmo3oqih50ncg9804eqbk/family1/743552f2e2424412a0f0585568727829 2023-11-11 11:53:34,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s00sveqiid0cnqm62qiktd7rrl2uk8ak2hrspvku061pmo3oqih50ncg9804eqbk/family1/743552f2e2424412a0f0585568727829 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/cb7b10ea1ecc4bf8ad3bd673b09d33ad_SeqId_47_ 2023-11-11 11:53:34,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s00sveqiid0cnqm62qiktd7rrl2uk8ak2hrspvku061pmo3oqih50ncg9804eqbk/family1/743552f2e2424412a0f0585568727829 into db6a44e3220a0eac47241b7eccc20166/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/cb7b10ea1ecc4bf8ad3bd673b09d33ad_SeqId_47_ - updating store file list. 2023-11-11 11:53:34,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/cb7b10ea1ecc4bf8ad3bd673b09d33ad_SeqId_47_ into db6a44e3220a0eac47241b7eccc20166/family1 2023-11-11 11:53:34,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s00sveqiid0cnqm62qiktd7rrl2uk8ak2hrspvku061pmo3oqih50ncg9804eqbk/family1/743552f2e2424412a0f0585568727829 into db6a44e3220a0eac47241b7eccc20166/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/cb7b10ea1ecc4bf8ad3bd673b09d33ad_SeqId_47_) 2023-11-11 11:53:34,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__s00sveqiid0cnqm62qiktd7rrl2uk8ak2hrspvku061pmo3oqih50ncg9804eqbk/family1/743552f2e2424412a0f0585568727829 2023-11-11 11:53:34,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-11 11:53:34,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-11 11:53:34,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(1912): db6a44e3220a0eac47241b7eccc20166/family1 is initiating minor compaction (all files) 2023-11-11 11:53:34,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3466555f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:53:34,372 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of db6a44e3220a0eac47241b7eccc20166/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:34,373 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/21b15d5e266a49518533d957cb398861, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/f821f7e1489747dfb14cfb7f690dedfd, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/cb7b10ea1ecc4bf8ad3bd673b09d33ad_SeqId_47_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp, totalSize=358.6 K 2023-11-11 11:53:34,375 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 21b15d5e266a49518533d957cb398861, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824916 2023-11-11 11:53:34,381 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting f821f7e1489747dfb14cfb7f690dedfd, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224916 2023-11-11 11:53:34,382 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting cb7b10ea1ecc4bf8ad3bd673b09d33ad_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824916 2023-11-11 11:53:34,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 11:53:34,390 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:53:34,393 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130d3cc4ef0cbef4b0da697962c4a75b7a1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130d3cc4ef0cbef4b0da697962c4a75b7a1 2023-11-11 11:53:34,395 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201ed613091264c4124a05ba6d9d490a1a2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201ed613091264c4124a05ba6d9d490a1a2 2023-11-11 11:53:34,400 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205e81243dc44a049b9b35ac5c92a58f38e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205e81243dc44a049b9b35ac5c92a58f38e 2023-11-11 11:53:34,400 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-11 11:53:34,401 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-11 11:53:34,401 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:34,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 11:53:34,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:53:34,407 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-11 11:53:34,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6560 sec 2023-11-11 11:53:34,463 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): db6a44e3220a0eac47241b7eccc20166#family1#compaction#11 average throughput is 3.75 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:53:34,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-11 11:53:34,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:35,038 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-11 11:53:35,040 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-11 11:53:35,040 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-11 11:53:35,045 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-11 11:53:35,058 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=db6a44e3220a0eac47241b7eccc20166, REOPEN/MOVE}] 2023-11-11 11:53:35,060 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=db6a44e3220a0eac47241b7eccc20166, REOPEN/MOVE 2023-11-11 11:53:35,061 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=db6a44e3220a0eac47241b7eccc20166, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:35,062 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699703615061"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703615061"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703615061"}]},"ts":"1699703615061"} 2023-11-11 11:53:35,065 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure db6a44e3220a0eac47241b7eccc20166, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:53:35,224 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:35,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:35,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing db6a44e3220a0eac47241b7eccc20166, disabling compactions & flushes 2023-11-11 11:53:35,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:35,701 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/.tmp/family1/99b62d9e1e1e409fabefc75935623ecb as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/99b62d9e1e1e409fabefc75935623ecb 2023-11-11 11:53:35,708 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in db6a44e3220a0eac47241b7eccc20166/family1 of db6a44e3220a0eac47241b7eccc20166 into 99b62d9e1e1e409fabefc75935623ecb(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:53:35,708 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:35,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:35,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:35,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. after waiting 0 ms 2023-11-11 11:53:35,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:35,709 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1699703614372; duration=1sec 2023-11-11 11:53:35,709 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:53:35,714 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/21b15d5e266a49518533d957cb398861, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/f821f7e1489747dfb14cfb7f690dedfd, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/cb7b10ea1ecc4bf8ad3bd673b09d33ad_SeqId_47_] to archive 2023-11-11 11:53:35,715 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:53:35,718 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/21b15d5e266a49518533d957cb398861 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/21b15d5e266a49518533d957cb398861 2023-11-11 11:53:35,720 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/f821f7e1489747dfb14cfb7f690dedfd to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/f821f7e1489747dfb14cfb7f690dedfd 2023-11-11 11:53:35,722 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/cb7b10ea1ecc4bf8ad3bd673b09d33ad_SeqId_47_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/cb7b10ea1ecc4bf8ad3bd673b09d33ad_SeqId_47_ 2023-11-11 11:53:35,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-11 11:53:35,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:35,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:35,730 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: db6a44e3220a0eac47241b7eccc20166 to self. 2023-11-11 11:53:35,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:35,733 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=db6a44e3220a0eac47241b7eccc20166, regionState=CLOSED 2023-11-11 11:53:35,734 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699703615733"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703615733"}]},"ts":"1699703615733"} 2023-11-11 11:53:35,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-11 11:53:35,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure db6a44e3220a0eac47241b7eccc20166, server=jenkins-hbase4.apache.org,41363,1699703601801 in 670 msec 2023-11-11 11:53:35,739 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=db6a44e3220a0eac47241b7eccc20166, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=true 2023-11-11 11:53:35,889 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=db6a44e3220a0eac47241b7eccc20166, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:35,890 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699703615889"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703615889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703615889"}]},"ts":"1699703615889"} 2023-11-11 11:53:35,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure db6a44e3220a0eac47241b7eccc20166, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:53:36,045 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:36,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:36,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db6a44e3220a0eac47241b7eccc20166, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:53:36,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:36,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:53:36,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:36,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:36,051 INFO [StoreOpener-db6a44e3220a0eac47241b7eccc20166-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:36,053 DEBUG [StoreOpener-db6a44e3220a0eac47241b7eccc20166-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1 2023-11-11 11:53:36,053 DEBUG [StoreOpener-db6a44e3220a0eac47241b7eccc20166-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1 2023-11-11 11:53:36,053 INFO [StoreOpener-db6a44e3220a0eac47241b7eccc20166-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db6a44e3220a0eac47241b7eccc20166 columnFamilyName family1 2023-11-11 11:53:36,063 DEBUG [StoreOpener-db6a44e3220a0eac47241b7eccc20166-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/99b62d9e1e1e409fabefc75935623ecb 2023-11-11 11:53:36,063 INFO [StoreOpener-db6a44e3220a0eac47241b7eccc20166-1] regionserver.HStore(310): Store=db6a44e3220a0eac47241b7eccc20166/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:53:36,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:36,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:36,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:53:36,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened db6a44e3220a0eac47241b7eccc20166; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60365467, jitterRate=-0.1004844456911087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:53:36,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:36,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166., pid=17, masterSystemTime=1699703616045 2023-11-11 11:53:36,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:36,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:53:36,076 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=db6a44e3220a0eac47241b7eccc20166, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:36,076 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699703616076"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703616076"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703616076"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703616076"}]},"ts":"1699703616076"} 2023-11-11 11:53:36,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-11 11:53:36,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure db6a44e3220a0eac47241b7eccc20166, server=jenkins-hbase4.apache.org,41363,1699703601801 in 187 msec 2023-11-11 11:53:36,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-11 11:53:36,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=db6a44e3220a0eac47241b7eccc20166, REOPEN/MOVE in 1.0230 sec 2023-11-11 11:53:36,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-11 11:53:36,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0410 sec 2023-11-11 11:53:36,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4770 sec 2023-11-11 11:53:36,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-11 11:53:36,102 INFO [Listener at localhost/39241] compactions.TestMobCompactor(278): alter status finished 2023-11-11 11:53:36,104 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-11 11:53:36,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-11 11:53:36,107 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-11 11:53:36,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:53:36,107 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704216107 2023-11-11 11:53:36,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 11:53:36,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-11 11:53:36,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 11:53:36,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x386c2d2e to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:53:36,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e74774f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:53:36,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:36,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:36,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:36,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:36,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:36,270 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288ebe2de78f9d44b09e71c56e59614655 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511288ebe2de78f9d44b09e71c56e59614655 2023-11-11 11:53:36,272 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 11:53:36,288 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:53:36,289 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:53:36,299 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:53:36,301 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:53:36,327 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/643dbe63b1e54f6f9db41455b5cb3e69 first=Optional[r05] last=Optional[r8] 2023-11-11 11:53:36,328 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=51 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/643dbe63b1e54f6f9db41455b5cb3e69}] 2023-11-11 11:53:36,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/643dbe63b1e54f6f9db41455b5cb3e69 for inclusion in db6a44e3220a0eac47241b7eccc20166/family1 2023-11-11 11:53:36,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-11 11:53:36,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:53:36,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:53:36,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/643dbe63b1e54f6f9db41455b5cb3e69 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__didq4pqck88k4j26uvsc5rfnd76m5togne210e22efbnpg67in39ekb5s6sb9bv8/family1/643dbe63b1e54f6f9db41455b5cb3e69 2023-11-11 11:53:36,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__didq4pqck88k4j26uvsc5rfnd76m5togne210e22efbnpg67in39ekb5s6sb9bv8/family1/643dbe63b1e54f6f9db41455b5cb3e69 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/0ccd7d9d11c04d7195929754ef30697c_SeqId_53_ 2023-11-11 11:53:36,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__didq4pqck88k4j26uvsc5rfnd76m5togne210e22efbnpg67in39ekb5s6sb9bv8/family1/643dbe63b1e54f6f9db41455b5cb3e69 into db6a44e3220a0eac47241b7eccc20166/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/0ccd7d9d11c04d7195929754ef30697c_SeqId_53_ - updating store file list. 2023-11-11 11:53:36,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/0ccd7d9d11c04d7195929754ef30697c_SeqId_53_ into db6a44e3220a0eac47241b7eccc20166/family1 2023-11-11 11:53:36,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__didq4pqck88k4j26uvsc5rfnd76m5togne210e22efbnpg67in39ekb5s6sb9bv8/family1/643dbe63b1e54f6f9db41455b5cb3e69 into db6a44e3220a0eac47241b7eccc20166/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/family1/0ccd7d9d11c04d7195929754ef30697c_SeqId_53_) 2023-11-11 11:53:36,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__didq4pqck88k4j26uvsc5rfnd76m5togne210e22efbnpg67in39ekb5s6sb9bv8/family1/643dbe63b1e54f6f9db41455b5cb3e69 2023-11-11 11:53:36,371 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 11:53:36,373 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:53:36,381 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120597daca6549744b9ac1e3d6632442f42 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120597daca6549744b9ac1e3d6632442f42 2023-11-11 11:53:36,383 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128693588cbd9ca4e509674f1254807e57e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128693588cbd9ca4e509674f1254807e57e 2023-11-11 11:53:36,383 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-11 11:53:36,383 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-11 11:53:36,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:36,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:36,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-11 11:53:36,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-11 11:53:36,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:53:36,385 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-11 11:53:36,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 280 msec 2023-11-11 11:53:36,491 INFO [Listener at localhost/39241] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=250 (was 213) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50562 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x933c3dc-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59344@0x386c2d2e-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50322 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50520 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59344@0x20f3b936 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/661627135.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50372 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50358 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59344@0x20f3b936-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: RS:0;jenkins-hbase4:41363-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50548 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59344@0x386c2d2e sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/661627135.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50522 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1051792013_17 at /127.0.0.1:50366 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb549dc-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50432 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50464 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59344@0x20f3b936-SendThread(127.0.0.1:59344) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50486 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50496 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59344@0x386c2d2e-SendThread(127.0.0.1:59344) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: hconnection-0x933c3dc-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50404 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50392 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1fb549dc-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50386 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50292 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x933c3dc-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=629 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 291) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=2551 (was 2863) 2023-11-11 11:53:36,507 INFO [Listener at localhost/39241] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=629, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=170, AvailableMemoryMB=2550 2023-11-11 11:53:36,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-11 11:53:36,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:36,513 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 11:53:36,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-11 11:53:36,514 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 11:53:36,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-11 11:53:36,515 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762 2023-11-11 11:53:36,516 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762 empty. 2023-11-11 11:53:36,516 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762 2023-11-11 11:53:36,516 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-11 11:53:36,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-11 11:53:36,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-11 11:53:36,926 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-11 11:53:36,928 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1c8723faa7ff7c4e6452e98575c3f762, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:53:37,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-11 11:53:37,337 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:53:37,337 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 1c8723faa7ff7c4e6452e98575c3f762, disabling compactions & flushes 2023-11-11 11:53:37,337 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:37,337 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:37,337 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. after waiting 0 ms 2023-11-11 11:53:37,337 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:37,337 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:37,337 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:37,340 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 11:53:37,341 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699703617341"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703617341"}]},"ts":"1699703617341"} 2023-11-11 11:53:37,343 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 11:53:37,344 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 11:53:37,344 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703617344"}]},"ts":"1699703617344"} 2023-11-11 11:53:37,346 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-11 11:53:37,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=1c8723faa7ff7c4e6452e98575c3f762, ASSIGN}] 2023-11-11 11:53:37,351 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=1c8723faa7ff7c4e6452e98575c3f762, ASSIGN 2023-11-11 11:53:37,352 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=1c8723faa7ff7c4e6452e98575c3f762, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:53:37,503 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1c8723faa7ff7c4e6452e98575c3f762, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:37,503 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699703617503"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703617503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703617503"}]},"ts":"1699703617503"} 2023-11-11 11:53:37,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 1c8723faa7ff7c4e6452e98575c3f762, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:53:37,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-11 11:53:37,658 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:37,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:37,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c8723faa7ff7c4e6452e98575c3f762, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:53:37,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 1c8723faa7ff7c4e6452e98575c3f762 2023-11-11 11:53:37,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:53:37,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1c8723faa7ff7c4e6452e98575c3f762 2023-11-11 11:53:37,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1c8723faa7ff7c4e6452e98575c3f762 2023-11-11 11:53:37,665 INFO [StoreOpener-1c8723faa7ff7c4e6452e98575c3f762-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1c8723faa7ff7c4e6452e98575c3f762 2023-11-11 11:53:37,667 DEBUG [StoreOpener-1c8723faa7ff7c4e6452e98575c3f762-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1 2023-11-11 11:53:37,667 DEBUG [StoreOpener-1c8723faa7ff7c4e6452e98575c3f762-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1 2023-11-11 11:53:37,668 INFO [StoreOpener-1c8723faa7ff7c4e6452e98575c3f762-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c8723faa7ff7c4e6452e98575c3f762 columnFamilyName family1 2023-11-11 11:53:37,671 INFO [StoreOpener-1c8723faa7ff7c4e6452e98575c3f762-1] regionserver.HStore(310): Store=1c8723faa7ff7c4e6452e98575c3f762/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:53:37,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762 2023-11-11 11:53:37,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762 2023-11-11 11:53:37,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1c8723faa7ff7c4e6452e98575c3f762 2023-11-11 11:53:37,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:53:37,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1c8723faa7ff7c4e6452e98575c3f762; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65353523, jitterRate=-0.02615661919116974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:53:37,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:37,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762., pid=21, masterSystemTime=1699703617658 2023-11-11 11:53:37,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:37,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:37,686 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1c8723faa7ff7c4e6452e98575c3f762, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:37,686 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699703617686"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703617686"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703617686"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703617686"}]},"ts":"1699703617686"} 2023-11-11 11:53:37,700 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-11 11:53:37,700 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 1c8723faa7ff7c4e6452e98575c3f762, server=jenkins-hbase4.apache.org,41363,1699703601801 in 183 msec 2023-11-11 11:53:37,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-11 11:53:37,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=1c8723faa7ff7c4e6452e98575c3f762, ASSIGN in 350 msec 2023-11-11 11:53:37,704 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 11:53:37,704 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703617704"}]},"ts":"1699703617704"} 2023-11-11 11:53:37,706 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-11 11:53:37,709 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 11:53:37,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1990 sec 2023-11-11 11:53:38,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-11 11:53:38,622 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-11 11:53:38,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:38,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:38,665 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:38,665 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:38,666 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:53:38,666 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:38,667 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:38,667 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:38,669 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:38,669 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:38,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:38,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:38,669 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:38,670 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:38,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:38,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:38,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:38,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:38,671 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:38,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:38,671 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:53:38,671 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:38,672 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:53:38,672 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:38,672 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:38,672 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:38,672 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. started... 2023-11-11 11:53:38,673 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c8723faa7ff7c4e6452e98575c3f762 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 11:53:39,099 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f1252d42ca4d4e5ebadefc71912efc6b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f1252d42ca4d4e5ebadefc71912efc6b 2023-11-11 11:53:39,103 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/d0a3305fa50c40f385441b586d4df0e9 2023-11-11 11:53:39,109 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/d0a3305fa50c40f385441b586d4df0e9 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/d0a3305fa50c40f385441b586d4df0e9 2023-11-11 11:53:39,114 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/d0a3305fa50c40f385441b586d4df0e9, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-11 11:53:39,115 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1c8723faa7ff7c4e6452e98575c3f762 in 443ms, sequenceid=5, compaction requested=false 2023-11-11 11:53:39,115 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:39,116 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:39,116 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:39,116 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:39,116 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:39,116 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,116 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:53:39,116 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:53:39,118 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,118 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:39,118 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,118 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:39,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:53:39,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@519b8463[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:39,120 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:39,120 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,121 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,121 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:39,121 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:53:39,121 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:39,121 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,121 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:39,123 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,123 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:53:39,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:39,123 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:39,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:39,123 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:53:39,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:39,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:39,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:39,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:39,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:39,126 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:53:39,126 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:39,126 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:39,126 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,126 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:39,129 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,129 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,129 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:39,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:39,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:39,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:39,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:39,130 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:39,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:39,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,131 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:39,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,138 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,138 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,138 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:39,138 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,138 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:39,138 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:39,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:39,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:39,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:39,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 11:53:39,138 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:39,138 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,139 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,139 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,139 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:39,139 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:39,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:39,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:39,239 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:39,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:39,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:39,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:39,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,247 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:39,247 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:39,248 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:53:39,248 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:39,249 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,249 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,250 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,250 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:39,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:39,250 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:39,250 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,251 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,252 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:53:39,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:39,252 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:53:39,252 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:39,252 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:53:39,252 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:39,252 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:39,252 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:39,253 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. started... 2023-11-11 11:53:39,253 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c8723faa7ff7c4e6452e98575c3f762 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 11:53:39,668 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a14f53a56c7f4c07aebc2d1eaed7350d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128a14f53a56c7f4c07aebc2d1eaed7350d 2023-11-11 11:53:40,075 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/ece75ae8e77941fb9f58e0109db61fa5 2023-11-11 11:53:40,081 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/ece75ae8e77941fb9f58e0109db61fa5 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/ece75ae8e77941fb9f58e0109db61fa5 2023-11-11 11:53:40,086 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/ece75ae8e77941fb9f58e0109db61fa5, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 11:53:40,088 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1c8723faa7ff7c4e6452e98575c3f762 in 835ms, sequenceid=9, compaction requested=false 2023-11-11 11:53:40,088 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:40,088 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:40,088 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:40,088 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:40,088 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,088 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:53:40,088 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:53:40,091 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,091 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:40,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:40,091 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,091 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:40,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:40,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:40,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:40,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:53:40,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@742e18bc[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:40,093 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:40,093 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,094 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,094 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:40,095 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:53:40,095 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:40,095 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,095 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:40,096 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:53:40,096 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,096 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:40,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:40,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:40,096 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:53:40,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:40,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:40,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:40,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:40,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:40,099 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:53:40,099 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:40,099 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:40,099 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,099 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:40,101 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,101 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:40,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:40,101 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:40,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:40,102 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:40,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:40,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:40,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,103 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:40,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,112 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,112 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:40,112 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:40,112 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:40,112 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:40,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:40,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:40,112 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:40,113 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,113 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,113 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,113 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,113 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:40,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:40,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:40,113 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:40,214 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:40,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:40,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:40,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:40,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,222 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:40,222 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:40,223 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:53:40,223 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:40,223 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,223 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,225 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,225 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:40,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:40,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:40,225 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:40,225 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:40,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,226 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,226 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:53:40,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:40,226 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:53:40,226 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:40,227 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:53:40,227 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:40,227 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:40,227 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:40,227 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. started... 2023-11-11 11:53:40,227 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c8723faa7ff7c4e6452e98575c3f762 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:40,643 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d9c0a685ef3a4fa38a21e42e9b53446f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201d9c0a685ef3a4fa38a21e42e9b53446f 2023-11-11 11:53:41,049 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/e36b7a3fdcf24161857267a4795fc20c 2023-11-11 11:53:41,057 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/e36b7a3fdcf24161857267a4795fc20c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/e36b7a3fdcf24161857267a4795fc20c 2023-11-11 11:53:41,063 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/e36b7a3fdcf24161857267a4795fc20c, entries=1, sequenceid=13, filesize=4.9 K 2023-11-11 11:53:41,064 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c8723faa7ff7c4e6452e98575c3f762 in 837ms, sequenceid=13, compaction requested=true 2023-11-11 11:53:41,064 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:41,064 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:41,064 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:41,064 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:41,064 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,064 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:53:41,064 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:53:41,066 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,066 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:41,067 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,067 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:41,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:41,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:41,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:41,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:53:41,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29760556[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:41,070 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:41,070 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,071 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,072 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,072 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:53:41,072 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:41,075 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:53:41,075 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:41,075 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,075 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:53:41,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:41,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:41,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:41,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:41,088 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:53:41,088 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:41,088 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:41,088 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,088 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:41,091 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,091 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,091 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:41,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:41,092 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:41,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,094 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:41,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,097 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:41,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:41,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:41,097 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,097 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:41,097 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,097 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,097 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:41,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:41,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:41,097 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:41,099 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:41,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:41,099 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,099 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:41,099 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 11:53:41,099 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,199 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:41,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:41,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:41,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:41,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,217 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:41,217 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:41,218 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:53:41,218 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:41,219 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,219 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,221 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,221 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:41,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:41,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:41,222 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,222 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:41,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,223 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,223 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:53:41,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,223 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:53:41,224 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:41,224 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:53:41,224 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:41,224 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:41,224 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:41,224 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. started... 2023-11-11 11:53:41,225 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c8723faa7ff7c4e6452e98575c3f762 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:41,248 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cd8f82d9fdac415784d29fab14e7dc9c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205cd8f82d9fdac415784d29fab14e7dc9c 2023-11-11 11:53:41,265 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 11:53:41,655 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/59bef3386dfb4fe4a898776261ebf59e 2023-11-11 11:53:41,663 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/59bef3386dfb4fe4a898776261ebf59e as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/59bef3386dfb4fe4a898776261ebf59e 2023-11-11 11:53:41,670 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/59bef3386dfb4fe4a898776261ebf59e, entries=1, sequenceid=17, filesize=4.9 K 2023-11-11 11:53:41,671 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c8723faa7ff7c4e6452e98575c3f762 in 446ms, sequenceid=17, compaction requested=true 2023-11-11 11:53:41,671 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:41,671 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:41,672 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:41,672 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:41,672 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,672 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:53:41,672 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:53:41,699 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,699 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:41,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:41,699 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,699 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:41,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:41,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:41,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:41,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:53:41,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54ee66b7[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:41,702 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:41,702 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,744 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,745 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:41,745 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,745 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:41,745 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:53:41,745 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:41,877 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:53:41,877 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,877 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:41,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:41,877 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:53:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:41,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:41,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:41,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:41,880 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:53:41,881 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:41,881 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:41,881 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,881 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:41,945 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,945 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:41,945 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:41,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:41,946 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:41,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:41,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:41,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,947 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:41,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:41,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:41,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:42,021 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:42,021 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:42,021 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:42,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 11:53:42,021 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:42,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:42,022 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:42,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:42,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:42,021 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:42,021 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:42,022 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:42,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:42,022 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:42,023 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:42,023 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:42,023 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:42,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:42,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:42,123 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:42,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:42,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:42,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:42,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:42,132 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:42,132 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:42,132 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:53:42,132 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:42,133 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:42,133 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:42,198 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:42,198 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:42,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:42,199 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:42,199 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:42,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:42,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:42,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:42,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:42,199 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:42,200 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:53:42,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:42,200 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:53:42,200 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:42,200 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:53:42,201 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:42,201 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:42,201 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:42,201 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. started... 2023-11-11 11:53:42,201 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c8723faa7ff7c4e6452e98575c3f762 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:42,616 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122874b5c805ffbd4da5b2db5ce041e30adf to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122874b5c805ffbd4da5b2db5ce041e30adf 2023-11-11 11:53:43,022 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/7405104c278e445aaab85071b0281b25 2023-11-11 11:53:43,028 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/7405104c278e445aaab85071b0281b25 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/7405104c278e445aaab85071b0281b25 2023-11-11 11:53:43,034 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/7405104c278e445aaab85071b0281b25, entries=1, sequenceid=21, filesize=4.9 K 2023-11-11 11:53:43,035 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c8723faa7ff7c4e6452e98575c3f762 in 834ms, sequenceid=21, compaction requested=true 2023-11-11 11:53:43,035 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:43,035 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:53:43,035 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:53:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,037 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:43,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:43,038 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,038 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:43,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:43,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:53:43,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59db48d5[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:43,039 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:43,040 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,041 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,041 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:43,041 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:53:43,041 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:43,041 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,041 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:43,043 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,043 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:53:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:43,043 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:43,043 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:53:43,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:43,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:43,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:43,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:43,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:43,047 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:53:43,047 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:43,047 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:43,047 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,047 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:43,050 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,050 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:43,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:43,050 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:43,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:43,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:43,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:43,051 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:43,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,053 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:43,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,056 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,056 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:43,057 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:43,057 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:43,057 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:43,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:43,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:43,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:43,057 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,058 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,058 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,058 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,058 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,058 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:43,058 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:43,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:43,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:43,158 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:43,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:43,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:43,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:43,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,166 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:43,166 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:43,166 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:53:43,166 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:43,167 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,167 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,168 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,168 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:43,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:43,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:43,169 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:43,169 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:43,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:43,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,170 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,170 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:53:43,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:43,170 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:53:43,170 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:43,171 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:53:43,171 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:43,171 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:43,171 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:43,171 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. started... 2023-11-11 11:53:43,171 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c8723faa7ff7c4e6452e98575c3f762 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:43,586 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315c44f3512e244c7fb7860853a4f91c6b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512315c44f3512e244c7fb7860853a4f91c6b 2023-11-11 11:53:43,992 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/c76a34c72acd4901ae473702b3d12cb1 2023-11-11 11:53:43,998 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/c76a34c72acd4901ae473702b3d12cb1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/c76a34c72acd4901ae473702b3d12cb1 2023-11-11 11:53:44,003 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/c76a34c72acd4901ae473702b3d12cb1, entries=1, sequenceid=25, filesize=4.9 K 2023-11-11 11:53:44,004 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c8723faa7ff7c4e6452e98575c3f762 in 833ms, sequenceid=25, compaction requested=true 2023-11-11 11:53:44,004 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:44,004 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:53:44,005 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:53:44,007 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,007 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:44,007 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,007 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:44,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:53:44,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d3440aa[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:44,009 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:44,009 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,015 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,015 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:44,015 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:53:44,015 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:44,015 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,015 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:44,017 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:53:44,017 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,017 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:44,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:44,017 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:53:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:44,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:44,020 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:53:44,020 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:44,020 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:44,020 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,020 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:44,022 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,022 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:44,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,022 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:44,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:44,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:44,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:44,022 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:44,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:44,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,024 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:44,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,026 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,026 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:44,026 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:44,026 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:44,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:44,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 11:53:44,026 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:44,026 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:44,026 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:44,027 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,027 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:44,027 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:44,027 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,027 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:44,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:44,128 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:44,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:44,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:44,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:44,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,137 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:44,137 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:44,138 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:53:44,138 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:44,138 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,138 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,140 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,140 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:44,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:44,141 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,141 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,142 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:53:44,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,142 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:53:44,142 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:44,143 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:53:44,143 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:44,143 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:44,143 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:44,143 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. started... 2023-11-11 11:53:44,143 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c8723faa7ff7c4e6452e98575c3f762 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:44,562 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f0bc3778f15a4176a31462567fe7881e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f0bc3778f15a4176a31462567fe7881e 2023-11-11 11:53:44,569 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/2f0e5e20da204f4ba663a67bd9269ca2 2023-11-11 11:53:44,575 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/2f0e5e20da204f4ba663a67bd9269ca2 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/2f0e5e20da204f4ba663a67bd9269ca2 2023-11-11 11:53:44,581 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/2f0e5e20da204f4ba663a67bd9269ca2, entries=1, sequenceid=29, filesize=4.9 K 2023-11-11 11:53:44,582 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c8723faa7ff7c4e6452e98575c3f762 in 439ms, sequenceid=29, compaction requested=true 2023-11-11 11:53:44,582 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:44,582 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:44,582 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:44,582 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:44,582 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,582 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:53:44,582 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:53:44,587 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,587 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:44,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:44,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:53:44,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4471b2ef[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:44,591 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:44,591 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,592 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,592 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:44,592 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:53:44,592 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:44,592 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,593 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:44,594 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,594 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:53:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:44,594 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:44,594 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:53:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:44,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:44,599 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:53:44,599 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:44,599 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:44,599 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,599 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:44,602 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,602 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:44,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,602 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:44,603 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,604 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,607 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,607 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,607 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:44,607 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:44,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:44,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:44,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 11:53:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:44,607 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:44,607 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:44,607 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,608 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,608 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,608 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:44,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:44,609 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:44,609 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:44,709 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:44,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:44,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:44,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:44,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,719 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:44,719 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:44,719 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:53:44,720 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:44,720 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,720 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,721 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:44,721 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:44,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:44,722 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:44,722 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:44,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:44,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,723 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,723 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:53:44,723 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:44,724 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:53:44,724 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:44,724 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:53:44,724 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:44,724 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:44,724 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:44,724 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. started... 2023-11-11 11:53:44,725 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c8723faa7ff7c4e6452e98575c3f762 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:45,140 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103bc605877af1d440f9e48a5fd722b0037 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103bc605877af1d440f9e48a5fd722b0037 2023-11-11 11:53:45,147 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/dae4b82599ef491d808a250af24983b2 2023-11-11 11:53:45,154 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/dae4b82599ef491d808a250af24983b2 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/dae4b82599ef491d808a250af24983b2 2023-11-11 11:53:45,160 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/dae4b82599ef491d808a250af24983b2, entries=1, sequenceid=33, filesize=4.9 K 2023-11-11 11:53:45,161 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c8723faa7ff7c4e6452e98575c3f762 in 436ms, sequenceid=33, compaction requested=true 2023-11-11 11:53:45,161 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:45,161 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:45,161 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:45,161 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:45,161 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,161 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:53:45,161 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:53:45,163 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,163 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:45,163 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,164 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:45,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:45,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:45,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:45,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:53:45,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@638daf08[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:45,165 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:45,165 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,168 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,168 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:45,168 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:53:45,168 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:45,168 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,168 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:45,169 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,169 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:53:45,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:45,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:45,170 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:45,170 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:53:45,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:45,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:45,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:45,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:45,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:45,176 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:53:45,176 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:45,176 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:45,176 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,176 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:45,178 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,178 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,178 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:45,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:45,178 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,180 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,182 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,182 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,182 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:45,182 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,182 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:45,182 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:45,183 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,182 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:45,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:45,183 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:45,183 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:45,184 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:45,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:45,184 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:45,284 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:45,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:45,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:45,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:45,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,292 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:45,292 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:45,293 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:53:45,293 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:45,293 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,293 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,296 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:45,296 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:45,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:45,297 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,297 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:45,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:45,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,297 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,298 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:53:45,298 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,298 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:53:45,298 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:45,298 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:53:45,298 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:45,298 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:45,298 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:45,298 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. started... 2023-11-11 11:53:45,299 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c8723faa7ff7c4e6452e98575c3f762 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:45,317 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907aa136d99a6a34c69a4d59458c97addb9 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907aa136d99a6a34c69a4d59458c97addb9 2023-11-11 11:53:45,724 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/67fdcb28a3cf4d6aad350af770ffab4d 2023-11-11 11:53:45,730 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/67fdcb28a3cf4d6aad350af770ffab4d as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/67fdcb28a3cf4d6aad350af770ffab4d 2023-11-11 11:53:45,736 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/67fdcb28a3cf4d6aad350af770ffab4d, entries=1, sequenceid=37, filesize=4.9 K 2023-11-11 11:53:45,737 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c8723faa7ff7c4e6452e98575c3f762 in 438ms, sequenceid=37, compaction requested=true 2023-11-11 11:53:45,737 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:45,737 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:45,737 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:45,737 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:45,737 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,738 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:53:45,738 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:53:45,739 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,739 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:45,740 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:45,740 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:45,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:53:45,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6013ce4c[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:45,741 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:45,741 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,743 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,743 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:45,743 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:53:45,743 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:45,743 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,743 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:45,744 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,744 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:53:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:45,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:45,744 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:45,745 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:53:45,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:45,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:45,749 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:53:45,749 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:45,749 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:45,749 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,749 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:45,751 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,751 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:45,751 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:45,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:45,752 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:45,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,754 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,759 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:45,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:45,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:45,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,760 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:45,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:45,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:45,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:45,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,761 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:45,761 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,761 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:45,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:45,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:45,861 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:45,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:45,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:45,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:45,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,869 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:45,869 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:45,869 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:53:45,869 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:45,870 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,870 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,871 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:45,871 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:45,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:45,871 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:45,871 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:45,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:45,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,872 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,873 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:53:45,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:45,873 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:53:45,873 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:45,874 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:53:45,874 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:45,874 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:45,874 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:45,874 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. started... 2023-11-11 11:53:45,874 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1c8723faa7ff7c4e6452e98575c3f762 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:46,289 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201a215d634ef74920b770abe6e1a9f00c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201a215d634ef74920b770abe6e1a9f00c 2023-11-11 11:53:46,695 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/753c406c10a740a0ad5a1766a90939d6 2023-11-11 11:53:46,701 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/753c406c10a740a0ad5a1766a90939d6 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/753c406c10a740a0ad5a1766a90939d6 2023-11-11 11:53:46,706 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/753c406c10a740a0ad5a1766a90939d6, entries=1, sequenceid=41, filesize=4.9 K 2023-11-11 11:53:46,707 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1c8723faa7ff7c4e6452e98575c3f762 in 833ms, sequenceid=41, compaction requested=true 2023-11-11 11:53:46,707 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:46,707 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:53:46,707 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:53:46,709 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,709 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:46,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:46,710 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,710 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:46,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:53:46,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f5df3f4[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:46,711 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:46,711 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,712 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,712 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:46,712 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:53:46,713 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:46,713 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,713 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:46,714 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,714 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:53:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:46,714 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:46,714 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:53:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:46,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:46,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:46,717 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:53:46,717 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:46,717 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:46,717 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,717 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:46,720 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:46,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:46,720 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,720 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:46,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:46,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:46,721 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:46,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:46,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,722 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,724 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,724 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:46,724 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:46,724 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:46,724 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:46,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-11 11:53:46,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:46,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:46,724 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,726 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:46,726 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,726 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,726 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,726 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:46,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:46,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:46,726 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:46,827 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:46,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:46,829 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-11 11:53:46,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 11:53:46,832 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 11:53:46,833 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704226833 2023-11-11 11:53:46,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:53:46,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 11:53:46,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-11 11:53:46,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:53:46,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x4e11b81a to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:53:46,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3127098, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:53:46,845 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:53:47,282 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a1c16b41a4df4443989b80daf6156a2d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1c16b41a4df4443989b80daf6156a2d 2023-11-11 11:53:47,283 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:53:47,296 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:53:47,297 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:53:47,304 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:53:47,306 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:53:47,315 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e195fcababeb4620aaf9615c5b85ca29 first=Optional[r5] last=Optional[r6] 2023-11-11 11:53:47,316 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e195fcababeb4620aaf9615c5b85ca29}] 2023-11-11 11:53:47,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e195fcababeb4620aaf9615c5b85ca29 for inclusion in 1c8723faa7ff7c4e6452e98575c3f762/family1 2023-11-11 11:53:47,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-11 11:53:47,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:53:47,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:47,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e195fcababeb4620aaf9615c5b85ca29 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__agk91moq1b73i5uq6hu4925lqf3ca1ultgdben1e6bolm53edkot75pen32d65au/family1/e195fcababeb4620aaf9615c5b85ca29 2023-11-11 11:53:47,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__agk91moq1b73i5uq6hu4925lqf3ca1ultgdben1e6bolm53edkot75pen32d65au/family1/e195fcababeb4620aaf9615c5b85ca29 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/0642c38694c649f0859e30d79b64a56f_SeqId_44_ 2023-11-11 11:53:47,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__agk91moq1b73i5uq6hu4925lqf3ca1ultgdben1e6bolm53edkot75pen32d65au/family1/e195fcababeb4620aaf9615c5b85ca29 into 1c8723faa7ff7c4e6452e98575c3f762/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/0642c38694c649f0859e30d79b64a56f_SeqId_44_ - updating store file list. 2023-11-11 11:53:47,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/0642c38694c649f0859e30d79b64a56f_SeqId_44_ into 1c8723faa7ff7c4e6452e98575c3f762/family1 2023-11-11 11:53:47,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__agk91moq1b73i5uq6hu4925lqf3ca1ultgdben1e6bolm53edkot75pen32d65au/family1/e195fcababeb4620aaf9615c5b85ca29 into 1c8723faa7ff7c4e6452e98575c3f762/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/0642c38694c649f0859e30d79b64a56f_SeqId_44_) 2023-11-11 11:53:47,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__agk91moq1b73i5uq6hu4925lqf3ca1ultgdben1e6bolm53edkot75pen32d65au/family1/e195fcababeb4620aaf9615c5b85ca29 2023-11-11 11:53:47,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 11:53:47,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 11:53:47,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(1912): 1c8723faa7ff7c4e6452e98575c3f762/family1 is initiating minor compaction 2023-11-11 11:53:47,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4bfad2df; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:53:47,341 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1c8723faa7ff7c4e6452e98575c3f762/family1 in testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:47,342 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/ece75ae8e77941fb9f58e0109db61fa5, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/e36b7a3fdcf24161857267a4795fc20c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/59bef3386dfb4fe4a898776261ebf59e, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/7405104c278e445aaab85071b0281b25, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/c76a34c72acd4901ae473702b3d12cb1, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/2f0e5e20da204f4ba663a67bd9269ca2, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/dae4b82599ef491d808a250af24983b2, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/67fdcb28a3cf4d6aad350af770ffab4d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/753c406c10a740a0ad5a1766a90939d6, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/0642c38694c649f0859e30d79b64a56f_SeqId_44_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp, totalSize=49.7 K 2023-11-11 11:53:47,342 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting ece75ae8e77941fb9f58e0109db61fa5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 11:53:47,342 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting e36b7a3fdcf24161857267a4795fc20c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 11:53:47,342 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 59bef3386dfb4fe4a898776261ebf59e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 11:53:47,342 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 7405104c278e445aaab85071b0281b25, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 11:53:47,342 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting c76a34c72acd4901ae473702b3d12cb1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 11:53:47,342 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 2f0e5e20da204f4ba663a67bd9269ca2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 11:53:47,342 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting dae4b82599ef491d808a250af24983b2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 11:53:47,342 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 67fdcb28a3cf4d6aad350af770ffab4d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 11:53:47,342 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 753c406c10a740a0ad5a1766a90939d6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 11:53:47,342 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 0642c38694c649f0859e30d79b64a56f_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 11:53:47,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:53:47,348 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:53:47,354 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f0bc3778f15a4176a31462567fe7881e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f0bc3778f15a4176a31462567fe7881e 2023-11-11 11:53:47,356 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103bc605877af1d440f9e48a5fd722b0037 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103bc605877af1d440f9e48a5fd722b0037 2023-11-11 11:53:47,356 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-11 11:53:47,356 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-11 11:53:47,357 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:53:47,357 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:53:47,405 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1c8723faa7ff7c4e6452e98575c3f762#family1#compaction#22 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:53:48,223 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/3394b9dbd1a8413daf6be6e186653cfd as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/3394b9dbd1a8413daf6be6e186653cfd 2023-11-11 11:53:48,230 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1c8723faa7ff7c4e6452e98575c3f762/family1 of 1c8723faa7ff7c4e6452e98575c3f762 into 3394b9dbd1a8413daf6be6e186653cfd(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:53:48,230 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:48,230 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699703627341; duration=0sec 2023-11-11 11:53:48,230 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:53:48,232 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123197c982e96a8a4328ad52c4b77dc99b8c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123197c982e96a8a4328ad52c4b77dc99b8c 2023-11-11 11:53:48,233 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:53:48,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/ece75ae8e77941fb9f58e0109db61fa5, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/e36b7a3fdcf24161857267a4795fc20c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/59bef3386dfb4fe4a898776261ebf59e, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/7405104c278e445aaab85071b0281b25, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/c76a34c72acd4901ae473702b3d12cb1, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/2f0e5e20da204f4ba663a67bd9269ca2, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/dae4b82599ef491d808a250af24983b2, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/67fdcb28a3cf4d6aad350af770ffab4d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/753c406c10a740a0ad5a1766a90939d6, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/0642c38694c649f0859e30d79b64a56f_SeqId_44_] to archive 2023-11-11 11:53:48,243 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:53:48,245 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/ece75ae8e77941fb9f58e0109db61fa5 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/ece75ae8e77941fb9f58e0109db61fa5 2023-11-11 11:53:48,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/e36b7a3fdcf24161857267a4795fc20c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/e36b7a3fdcf24161857267a4795fc20c 2023-11-11 11:53:48,247 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/59bef3386dfb4fe4a898776261ebf59e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/59bef3386dfb4fe4a898776261ebf59e 2023-11-11 11:53:48,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/7405104c278e445aaab85071b0281b25 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/7405104c278e445aaab85071b0281b25 2023-11-11 11:53:48,250 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/c76a34c72acd4901ae473702b3d12cb1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/c76a34c72acd4901ae473702b3d12cb1 2023-11-11 11:53:48,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/2f0e5e20da204f4ba663a67bd9269ca2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/2f0e5e20da204f4ba663a67bd9269ca2 2023-11-11 11:53:48,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/dae4b82599ef491d808a250af24983b2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/dae4b82599ef491d808a250af24983b2 2023-11-11 11:53:48,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/67fdcb28a3cf4d6aad350af770ffab4d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/67fdcb28a3cf4d6aad350af770ffab4d 2023-11-11 11:53:48,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/753c406c10a740a0ad5a1766a90939d6 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/753c406c10a740a0ad5a1766a90939d6 2023-11-11 11:53:48,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/0642c38694c649f0859e30d79b64a56f_SeqId_44_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/0642c38694c649f0859e30d79b64a56f_SeqId_44_ 2023-11-11 11:53:48,267 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/af451030c67a4561901d38fcdec05bac first=Optional[r1] last=Optional[r4] 2023-11-11 11:53:48,267 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/af451030c67a4561901d38fcdec05bac}] 2023-11-11 11:53:48,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/af451030c67a4561901d38fcdec05bac for inclusion in 1c8723faa7ff7c4e6452e98575c3f762/family1 2023-11-11 11:53:48,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-11 11:53:48,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:53:48,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:48,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/af451030c67a4561901d38fcdec05bac to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hiumcs0jbkts4j396i6fqig9vhj0a2frtl6h3errg08th1qtgba3sohkllntlht0/family1/af451030c67a4561901d38fcdec05bac 2023-11-11 11:53:48,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hiumcs0jbkts4j396i6fqig9vhj0a2frtl6h3errg08th1qtgba3sohkllntlht0/family1/af451030c67a4561901d38fcdec05bac as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/f4677cd31586492593799fa7c7a13fb3_SeqId_47_ 2023-11-11 11:53:48,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hiumcs0jbkts4j396i6fqig9vhj0a2frtl6h3errg08th1qtgba3sohkllntlht0/family1/af451030c67a4561901d38fcdec05bac into 1c8723faa7ff7c4e6452e98575c3f762/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/f4677cd31586492593799fa7c7a13fb3_SeqId_47_ - updating store file list. 2023-11-11 11:53:48,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/f4677cd31586492593799fa7c7a13fb3_SeqId_47_ into 1c8723faa7ff7c4e6452e98575c3f762/family1 2023-11-11 11:53:48,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hiumcs0jbkts4j396i6fqig9vhj0a2frtl6h3errg08th1qtgba3sohkllntlht0/family1/af451030c67a4561901d38fcdec05bac into 1c8723faa7ff7c4e6452e98575c3f762/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/f4677cd31586492593799fa7c7a13fb3_SeqId_47_) 2023-11-11 11:53:48,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hiumcs0jbkts4j396i6fqig9vhj0a2frtl6h3errg08th1qtgba3sohkllntlht0/family1/af451030c67a4561901d38fcdec05bac 2023-11-11 11:53:48,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-11 11:53:48,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-11 11:53:48,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(1912): 1c8723faa7ff7c4e6452e98575c3f762/family1 is initiating minor compaction (all files) 2023-11-11 11:53:48,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@34ad13fb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:53:48,283 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1c8723faa7ff7c4e6452e98575c3f762/family1 in testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:53:48,284 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/d0a3305fa50c40f385441b586d4df0e9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/3394b9dbd1a8413daf6be6e186653cfd, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/f4677cd31586492593799fa7c7a13fb3_SeqId_47_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp, totalSize=178.1 K 2023-11-11 11:53:48,284 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting d0a3305fa50c40f385441b586d4df0e9, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824916 2023-11-11 11:53:48,284 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 3394b9dbd1a8413daf6be6e186653cfd, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224916 2023-11-11 11:53:48,285 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting f4677cd31586492593799fa7c7a13fb3_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965224916 2023-11-11 11:53:48,285 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:53:48,286 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:53:48,288 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201d9c0a685ef3a4fa38a21e42e9b53446f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201d9c0a685ef3a4fa38a21e42e9b53446f 2023-11-11 11:53:48,289 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205cd8f82d9fdac415784d29fab14e7dc9c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205cd8f82d9fdac415784d29fab14e7dc9c 2023-11-11 11:53:48,290 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122874b5c805ffbd4da5b2db5ce041e30adf to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122874b5c805ffbd4da5b2db5ce041e30adf 2023-11-11 11:53:48,292 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512315c44f3512e244c7fb7860853a4f91c6b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512315c44f3512e244c7fb7860853a4f91c6b 2023-11-11 11:53:48,292 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-11 11:53:48,292 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-11 11:53:48,293 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:53:48,293 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:53:48,305 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1c8723faa7ff7c4e6452e98575c3f762#family1#compaction#23 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:53:48,357 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113017f1e3c4a1f14caeb00d07c58b4c0a62 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113017f1e3c4a1f14caeb00d07c58b4c0a62 2023-11-11 11:53:48,359 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:53:48,398 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c4834d8ee36d4c878df359522ab032a4 first=Optional[r00] last=Optional[r8] 2023-11-11 11:53:48,399 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c4834d8ee36d4c878df359522ab032a4}] 2023-11-11 11:53:48,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c4834d8ee36d4c878df359522ab032a4 for inclusion in 1c8723faa7ff7c4e6452e98575c3f762/family1 2023-11-11 11:53:48,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-11 11:53:48,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:53:48,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:48,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c4834d8ee36d4c878df359522ab032a4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rmbca9aaqhi9dungq6gbg18b4h56t7a2k1h8cljlqpbj4bachb6r1mjicj26v9lc/family1/c4834d8ee36d4c878df359522ab032a4 2023-11-11 11:53:48,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rmbca9aaqhi9dungq6gbg18b4h56t7a2k1h8cljlqpbj4bachb6r1mjicj26v9lc/family1/c4834d8ee36d4c878df359522ab032a4 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/33141affe65247f1bbb37e7682ed681e_SeqId_49_ 2023-11-11 11:53:48,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rmbca9aaqhi9dungq6gbg18b4h56t7a2k1h8cljlqpbj4bachb6r1mjicj26v9lc/family1/c4834d8ee36d4c878df359522ab032a4 into 1c8723faa7ff7c4e6452e98575c3f762/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/33141affe65247f1bbb37e7682ed681e_SeqId_49_ - updating store file list. 2023-11-11 11:53:48,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/33141affe65247f1bbb37e7682ed681e_SeqId_49_ into 1c8723faa7ff7c4e6452e98575c3f762/family1 2023-11-11 11:53:48,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rmbca9aaqhi9dungq6gbg18b4h56t7a2k1h8cljlqpbj4bachb6r1mjicj26v9lc/family1/c4834d8ee36d4c878df359522ab032a4 into 1c8723faa7ff7c4e6452e98575c3f762/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/33141affe65247f1bbb37e7682ed681e_SeqId_49_) 2023-11-11 11:53:48,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rmbca9aaqhi9dungq6gbg18b4h56t7a2k1h8cljlqpbj4bachb6r1mjicj26v9lc/family1/c4834d8ee36d4c878df359522ab032a4 2023-11-11 11:53:48,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:53:48,425 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:53:48,427 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201a215d634ef74920b770abe6e1a9f00c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201a215d634ef74920b770abe6e1a9f00c 2023-11-11 11:53:48,429 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128a14f53a56c7f4c07aebc2d1eaed7350d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128a14f53a56c7f4c07aebc2d1eaed7350d 2023-11-11 11:53:48,430 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f1252d42ca4d4e5ebadefc71912efc6b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f1252d42ca4d4e5ebadefc71912efc6b 2023-11-11 11:53:48,430 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-11 11:53:48,430 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-11 11:53:48,431 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:53:48,431 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:53:48,431 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:53:48,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:53:48,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:53:48,432 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 11:53:48,434 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.6020 sec 2023-11-11 11:53:48,548 INFO [Listener at localhost/39241] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=265 (was 250) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59344@0x4e11b81a-SendThread(127.0.0.1:59344) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1051792013_17 at /127.0.0.1:37674 [Receiving block BP-1248041169-172.31.14.131-1699703597170:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37522 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-1248041169-172.31.14.131-1699703597170:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37478 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x14286e05-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-1248041169-172.31.14.131-1699703597170:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/cluster_ba247ec2-1551-003a-d119-7315b0da3078/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314b03a70241d64dff8fe2c144cf0546cf_del java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: Thread-480 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x14286e05-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37410 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x14286e05-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37582 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37620 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37672 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x14286e05-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x14286e05-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37464 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37612 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59344@0x4e11b81a sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/661627135.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x67172ff9-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x14286e05-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37532 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:60576 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37584 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37640 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37544 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x14286e05-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37440 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/f498960277af4e39b3e58ff84f565b07 block BP-1248041169-172.31.14.131-1699703597170:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/cluster_ba247ec2-1551-003a-d119-7315b0da3078/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:50404 [Waiting for operation #38] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-273042479_17 at /127.0.0.1:37484 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1051792013_17 at /127.0.0.1:37558 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59344@0x4e11b81a-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) - Thread LEAK? -, OpenFileDescriptor=644 (was 629) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=247 (was 292), ProcessCount=170 (was 170), AvailableMemoryMB=2432 (was 2550) 2023-11-11 11:53:48,560 INFO [Listener at localhost/39241] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=265, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=247, ProcessCount=170, AvailableMemoryMB=2431 2023-11-11 11:53:48,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-11 11:53:48,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:48,565 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 11:53:48,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-11 11:53:48,566 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 11:53:48,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-11 11:53:48,567 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5 2023-11-11 11:53:48,568 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5 empty. 2023-11-11 11:53:48,568 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5 2023-11-11 11:53:48,568 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-11 11:53:48,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-11 11:53:48,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-11 11:53:48,977 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-11 11:53:48,979 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4a6a122edb2f0f032fe6b9e6c8ec2ec5, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:53:48,990 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:53:48,990 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 4a6a122edb2f0f032fe6b9e6c8ec2ec5, disabling compactions & flushes 2023-11-11 11:53:48,990 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:48,990 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:48,990 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. after waiting 0 ms 2023-11-11 11:53:48,990 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:48,990 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:48,990 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:53:48,993 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 11:53:48,994 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699703628994"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703628994"}]},"ts":"1699703628994"} 2023-11-11 11:53:48,995 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 11:53:48,996 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 11:53:48,997 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703628996"}]},"ts":"1699703628996"} 2023-11-11 11:53:48,998 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-11 11:53:49,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=4a6a122edb2f0f032fe6b9e6c8ec2ec5, ASSIGN}] 2023-11-11 11:53:49,003 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=4a6a122edb2f0f032fe6b9e6c8ec2ec5, ASSIGN 2023-11-11 11:53:49,004 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=4a6a122edb2f0f032fe6b9e6c8ec2ec5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:53:49,130 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/.tmp/family1/f498960277af4e39b3e58ff84f565b07 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/f498960277af4e39b3e58ff84f565b07 2023-11-11 11:53:49,136 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1c8723faa7ff7c4e6452e98575c3f762/family1 of 1c8723faa7ff7c4e6452e98575c3f762 into f498960277af4e39b3e58ff84f565b07(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:53:49,136 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:53:49,136 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1699703628283; duration=0sec 2023-11-11 11:53:49,136 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:53:49,155 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=4a6a122edb2f0f032fe6b9e6c8ec2ec5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:49,155 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699703629155"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703629155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703629155"}]},"ts":"1699703629155"} 2023-11-11 11:53:49,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 4a6a122edb2f0f032fe6b9e6c8ec2ec5, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:53:49,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-11 11:53:49,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/d0a3305fa50c40f385441b586d4df0e9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/3394b9dbd1a8413daf6be6e186653cfd, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/f4677cd31586492593799fa7c7a13fb3_SeqId_47_] to archive 2023-11-11 11:53:49,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:53:49,238 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/d0a3305fa50c40f385441b586d4df0e9 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/d0a3305fa50c40f385441b586d4df0e9 2023-11-11 11:53:49,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/3394b9dbd1a8413daf6be6e186653cfd to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/3394b9dbd1a8413daf6be6e186653cfd 2023-11-11 11:53:49,241 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/f4677cd31586492593799fa7c7a13fb3_SeqId_47_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/family1/f4677cd31586492593799fa7c7a13fb3_SeqId_47_ 2023-11-11 11:53:49,309 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:49,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:49,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a6a122edb2f0f032fe6b9e6c8ec2ec5, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:53:49,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 4a6a122edb2f0f032fe6b9e6c8ec2ec5 2023-11-11 11:53:49,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:53:49,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 2023-11-11 11:53:49,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 2023-11-11 11:53:49,315 INFO [StoreOpener-4a6a122edb2f0f032fe6b9e6c8ec2ec5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4a6a122edb2f0f032fe6b9e6c8ec2ec5 2023-11-11 11:53:49,316 DEBUG [StoreOpener-4a6a122edb2f0f032fe6b9e6c8ec2ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 2023-11-11 11:53:49,316 DEBUG [StoreOpener-4a6a122edb2f0f032fe6b9e6c8ec2ec5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 2023-11-11 11:53:49,317 INFO [StoreOpener-4a6a122edb2f0f032fe6b9e6c8ec2ec5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a6a122edb2f0f032fe6b9e6c8ec2ec5 columnFamilyName family1 2023-11-11 11:53:49,318 INFO [StoreOpener-4a6a122edb2f0f032fe6b9e6c8ec2ec5-1] regionserver.HStore(310): Store=4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:53:49,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5 2023-11-11 11:53:49,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5 2023-11-11 11:53:49,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 2023-11-11 11:53:49,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:53:49,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4a6a122edb2f0f032fe6b9e6c8ec2ec5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61283876, jitterRate=-0.08679908514022827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:53:49,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:53:49,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5., pid=25, masterSystemTime=1699703629309 2023-11-11 11:53:49,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:49,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:49,328 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=4a6a122edb2f0f032fe6b9e6c8ec2ec5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:49,328 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699703629328"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703629328"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703629328"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703629328"}]},"ts":"1699703629328"} 2023-11-11 11:53:49,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-11 11:53:49,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 4a6a122edb2f0f032fe6b9e6c8ec2ec5, server=jenkins-hbase4.apache.org,41363,1699703601801 in 173 msec 2023-11-11 11:53:49,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-11 11:53:49,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=4a6a122edb2f0f032fe6b9e6c8ec2ec5, ASSIGN in 331 msec 2023-11-11 11:53:49,335 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 11:53:49,335 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703629335"}]},"ts":"1699703629335"} 2023-11-11 11:53:49,336 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-11 11:53:49,339 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 11:53:49,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 777 msec 2023-11-11 11:53:49,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-11 11:53:49,671 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-11 11:53:49,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:49,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:49,699 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:49,699 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:49,699 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:53:49,699 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:49,700 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:49,700 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:49,702 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:49,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:49,702 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:49,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:49,703 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:49,703 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:49,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:49,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:49,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:49,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:49,704 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:49,704 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:49,704 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:53:49,704 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:49,704 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:53:49,704 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:49,705 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:49,705 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:49,705 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. started... 2023-11-11 11:53:49,705 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a6a122edb2f0f032fe6b9e6c8ec2ec5 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 11:53:50,125 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113038b2174a6ecc4351bf412d05523fbb1b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015113038b2174a6ecc4351bf412d05523fbb1b 2023-11-11 11:53:50,530 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/71f556278b594d72a42efcd223bb71cd 2023-11-11 11:53:50,536 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/71f556278b594d72a42efcd223bb71cd as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/71f556278b594d72a42efcd223bb71cd 2023-11-11 11:53:50,543 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/71f556278b594d72a42efcd223bb71cd, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-11 11:53:50,544 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 in 839ms, sequenceid=5, compaction requested=false 2023-11-11 11:53:50,544 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:50,545 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:53:50,545 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:50,545 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:50,545 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:50,545 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,545 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:53:50,545 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:53:50,547 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,547 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:50,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:50,548 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,548 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:50,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:50,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:50,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:50,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:53:50,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56f2cc3a[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:50,549 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:50,550 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,551 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,551 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:50,551 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:53:50,551 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:50,551 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,551 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:50,552 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,552 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:53:50,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:50,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:50,553 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:50,553 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:53:50,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:50,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:50,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:50,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:50,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:50,555 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:53:50,556 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:50,556 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:50,556 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,556 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:50,559 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,559 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:50,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:50,559 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:50,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:50,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:50,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:50,559 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:50,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,561 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:50,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,563 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,564 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,564 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:50,564 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:50,564 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:50,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:50,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:50,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:50,564 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,564 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,564 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,564 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,564 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:50,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:50,564 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:50,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:50,564 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:50,665 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:50,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:50,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:50,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:50,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,676 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:50,676 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:50,676 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:53:50,676 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:50,677 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,677 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,678 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,678 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:50,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:50,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:50,679 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:50,679 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:50,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:50,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,680 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,680 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:53:50,680 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:50,680 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:53:50,680 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:50,680 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:53:50,680 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:50,680 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:50,680 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:50,680 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. started... 2023-11-11 11:53:50,681 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a6a122edb2f0f032fe6b9e6c8ec2ec5 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 11:53:51,098 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112879bfb51270ae4cfa9633a41725a85fb5 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112879bfb51270ae4cfa9633a41725a85fb5 2023-11-11 11:53:51,504 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/62ec3b629e1d4a97bc0099cebd872cc9 2023-11-11 11:53:51,510 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/62ec3b629e1d4a97bc0099cebd872cc9 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/62ec3b629e1d4a97bc0099cebd872cc9 2023-11-11 11:53:51,515 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/62ec3b629e1d4a97bc0099cebd872cc9, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 11:53:51,515 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 in 834ms, sequenceid=9, compaction requested=false 2023-11-11 11:53:51,516 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:53:51,516 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:51,516 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:51,516 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:51,516 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,516 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:53:51,516 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:53:51,527 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,527 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:51,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:51,527 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,527 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:51,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:51,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:51,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:51,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:53:51,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5889cc03[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:51,529 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:51,529 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,530 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,530 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:51,530 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,530 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:51,530 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:53:51,530 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:51,532 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,532 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:53:51,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:51,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:51,532 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:51,532 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:53:51,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:51,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:51,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:51,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:51,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:51,534 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:53:51,534 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:51,534 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:51,534 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,534 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:51,537 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,537 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:51,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:51,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,537 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:51,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:51,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:51,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:51,538 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,539 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:51,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,542 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,542 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:51,542 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:51,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:51,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:51,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:51,542 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:51,542 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:51,542 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:51,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:51,542 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,542 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:51,542 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,543 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:51,543 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,543 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,643 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:51,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:51,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:51,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:51,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,650 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:51,650 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:51,650 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:53:51,650 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:51,650 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,650 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,651 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:51,651 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:51,652 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:51,652 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:51,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:51,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,653 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,653 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:53:51,653 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:51,653 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:53:51,653 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:51,653 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:53:51,653 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:51,653 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:51,653 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:51,653 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. started... 2023-11-11 11:53:51,653 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a6a122edb2f0f032fe6b9e6c8ec2ec5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:52,067 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512018dc65455719845aca5eb099390f6b083 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512018dc65455719845aca5eb099390f6b083 2023-11-11 11:53:52,473 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/34875b113f164b869f04d5e73caad7a8 2023-11-11 11:53:52,479 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/34875b113f164b869f04d5e73caad7a8 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/34875b113f164b869f04d5e73caad7a8 2023-11-11 11:53:52,484 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/34875b113f164b869f04d5e73caad7a8, entries=1, sequenceid=13, filesize=4.9 K 2023-11-11 11:53:52,485 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 in 832ms, sequenceid=13, compaction requested=true 2023-11-11 11:53:52,485 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:53:52,485 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:52,485 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:52,485 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:52,485 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,485 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:53:52,485 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:53:52,487 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,487 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:52,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:52,487 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,487 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:52,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:52,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:52,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:52,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:53:52,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@269608f0[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:52,489 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:52,489 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,490 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,490 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:52,490 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:53:52,491 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:52,491 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,491 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:52,493 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:53:52,493 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,493 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:52,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,493 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:53:52,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:52,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:52,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:52,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:52,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:52,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:52,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:52,496 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:53:52,496 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:52,496 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:52,496 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,496 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:52,497 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,497 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:52,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,498 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:52,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:52,498 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:52,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,501 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:52,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,504 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,504 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,504 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:52,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:52,504 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:52,504 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:52,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:52,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:52,504 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:52,504 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,505 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,505 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:52,505 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,505 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:52,505 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:52,605 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:52,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:52,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:52,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:52,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,612 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:52,612 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:52,612 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:53:52,612 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:52,613 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,613 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,615 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,615 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:52,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:52,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:52,615 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:52,615 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:52,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:52,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,616 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,616 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:53:52,616 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:52,616 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:53:52,617 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:52,617 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:53:52,617 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:52,617 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:52,617 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:52,617 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. started... 2023-11-11 11:53:52,617 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a6a122edb2f0f032fe6b9e6c8ec2ec5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:53,031 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f5d065033f97463b8c3d72e176c53ce8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205f5d065033f97463b8c3d72e176c53ce8 2023-11-11 11:53:53,437 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/98dc1feba9dc4de0887189f675643d2d 2023-11-11 11:53:53,443 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/98dc1feba9dc4de0887189f675643d2d as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/98dc1feba9dc4de0887189f675643d2d 2023-11-11 11:53:53,447 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/98dc1feba9dc4de0887189f675643d2d, entries=1, sequenceid=17, filesize=4.9 K 2023-11-11 11:53:53,448 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 in 831ms, sequenceid=17, compaction requested=true 2023-11-11 11:53:53,448 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:53:53,448 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:53:53,448 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:53:53,450 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,450 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:53,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:53:53,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56249d85[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:53,452 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:53,452 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,453 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,453 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:53,453 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:53:53,453 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:53,453 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,453 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:53,454 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:53:53,455 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:53,455 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,455 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:53:53,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:53,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:53,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:53,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:53,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:53,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:53,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:53,457 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:53:53,457 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:53,457 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:53,457 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,457 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:53,460 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,460 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:53,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,460 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:53,461 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,462 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,468 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,468 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,468 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:53,468 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:53,468 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:53,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:53,468 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:53,468 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:53,468 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:53,468 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,468 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,468 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:53,468 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:53,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:53,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:53,568 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:53,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:53,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:53,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:53,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,575 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:53,575 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:53,575 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:53:53,575 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:53,576 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,576 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,577 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:53,577 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:53,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:53,577 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:53,577 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:53,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:53,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,578 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,578 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:53:53,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:53,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:53:53,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:53,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:53:53,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:53,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:53,579 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:53,579 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. started... 2023-11-11 11:53:53,579 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a6a122edb2f0f032fe6b9e6c8ec2ec5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:53,992 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a27e2296ccb94fb9bdf451f6dff4bf92 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228a27e2296ccb94fb9bdf451f6dff4bf92 2023-11-11 11:53:54,398 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/ac571869ce1241529a212662b4278e01 2023-11-11 11:53:54,404 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/ac571869ce1241529a212662b4278e01 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/ac571869ce1241529a212662b4278e01 2023-11-11 11:53:54,409 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/ac571869ce1241529a212662b4278e01, entries=1, sequenceid=21, filesize=4.9 K 2023-11-11 11:53:54,409 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 in 830ms, sequenceid=21, compaction requested=true 2023-11-11 11:53:54,410 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:53:54,410 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:54,410 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:54,410 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:54,410 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,410 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:53:54,410 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:53:54,411 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,411 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:54,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:54,412 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,412 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:54,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:54,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:54,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:54,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:53:54,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16f71867[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:54,414 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:54,414 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,415 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,415 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:54,415 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:53:54,415 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:54,415 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,415 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:54,418 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:53:54,418 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,418 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:54,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,418 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:53:54,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:54,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:54,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:54,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:54,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:54,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:54,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:54,421 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:53:54,421 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:54,421 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:54,421 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,421 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:54,422 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,422 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,422 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:54,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:54,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:54,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:54,423 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:54,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:54,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:54,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,425 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:54,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,427 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,427 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:54,427 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:54,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:54,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:54,427 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:54,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:54,427 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:54,427 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,427 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,427 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,427 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:54,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-11 11:53:54,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:54,428 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:54,427 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:54,428 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,528 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:54,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:54,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:54,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:54,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,535 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:54,535 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:54,535 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:53:54,535 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:54,536 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,536 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,537 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,537 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:54,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:54,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:54,537 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:54,537 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:54,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:54,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,538 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,539 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:53:54,539 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:54,539 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:53:54,539 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:54,539 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:53:54,539 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:54,539 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:54,539 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:54,539 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. started... 2023-11-11 11:53:54,539 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a6a122edb2f0f032fe6b9e6c8ec2ec5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:54,846 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 11:53:54,954 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314eb296ee02ca4ea0a4a0b7e1187f8f67 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512314eb296ee02ca4ea0a4a0b7e1187f8f67 2023-11-11 11:53:55,360 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/99cb39319fb94b218be31b1b907fbb69 2023-11-11 11:53:55,366 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/99cb39319fb94b218be31b1b907fbb69 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/99cb39319fb94b218be31b1b907fbb69 2023-11-11 11:53:55,371 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/99cb39319fb94b218be31b1b907fbb69, entries=1, sequenceid=25, filesize=4.9 K 2023-11-11 11:53:55,372 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 in 833ms, sequenceid=25, compaction requested=true 2023-11-11 11:53:55,372 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:53:55,372 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:55,372 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:55,372 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:55,372 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,373 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:53:55,373 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:53:55,376 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,376 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:55,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:55,376 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,376 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:55,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:55,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:55,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:55,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:53:55,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8276e[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:55,378 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:55,378 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,379 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,379 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:55,379 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:53:55,379 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,379 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:55,379 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:55,381 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,381 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:53:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:55,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:55,381 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:55,381 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:53:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:55,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:55,384 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:53:55,384 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:55,384 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:55,384 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,384 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:55,386 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,386 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:55,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,386 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:55,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:55,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:55,387 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,388 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,391 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,391 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,391 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:55,391 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,392 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:55,392 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:55,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-11 11:53:55,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:55,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:55,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:55,392 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:55,392 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,392 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,392 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,392 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:55,392 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:55,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:55,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:55,493 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:55,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:55,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:55,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:55,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,500 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:55,500 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:55,500 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:53:55,500 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:55,501 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,501 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,502 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,502 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:55,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:55,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:55,503 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,503 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:55,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:55,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,504 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,504 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:53:55,504 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,504 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:53:55,504 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:55,504 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:53:55,505 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:55,505 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:55,505 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:55,505 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. started... 2023-11-11 11:53:55,505 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a6a122edb2f0f032fe6b9e6c8ec2ec5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:55,519 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c4184988d0184023aee974d6c9060424 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101c4184988d0184023aee974d6c9060424 2023-11-11 11:53:55,926 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/9e374b67fa924e3e901fc85d83b6a6ed 2023-11-11 11:53:55,931 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/9e374b67fa924e3e901fc85d83b6a6ed as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/9e374b67fa924e3e901fc85d83b6a6ed 2023-11-11 11:53:55,936 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/9e374b67fa924e3e901fc85d83b6a6ed, entries=1, sequenceid=29, filesize=4.9 K 2023-11-11 11:53:55,937 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 in 432ms, sequenceid=29, compaction requested=true 2023-11-11 11:53:55,937 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:53:55,937 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:55,937 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:55,937 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:55,937 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,937 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:53:55,937 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:53:55,939 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,939 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:55,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:55,939 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,939 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:55,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:55,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:55,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:55,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:53:55,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@164f7e17[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:55,941 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:55,941 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,942 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,942 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:55,942 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:53:55,942 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:55,942 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,943 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:55,945 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,945 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:53:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:55,945 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:55,945 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:53:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:55,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:55,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:55,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:55,947 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:53:55,947 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:55,947 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:55,947 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,947 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:55,951 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,952 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:55,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:55,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,952 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:55,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:55,952 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:55,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:55,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:55,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,953 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,956 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,956 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:55,956 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,956 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:55,956 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:55,956 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:55,956 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:55,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:55,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:55,956 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,956 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,956 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:55,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:55,957 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:55,957 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:56,057 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:56,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:56,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:56,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:56,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,064 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:56,064 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:56,064 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:53:56,064 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:56,065 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,065 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,067 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:56,067 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:56,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:56,068 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,068 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,068 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,069 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:53:56,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,069 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:53:56,069 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:56,069 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:53:56,069 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:56,069 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:56,069 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:56,069 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. started... 2023-11-11 11:53:56,069 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a6a122edb2f0f032fe6b9e6c8ec2ec5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:56,483 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010343215f937dda43b0a596a69a4c58e20b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010343215f937dda43b0a596a69a4c58e20b 2023-11-11 11:53:56,889 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/7bc55d52e3fe4923ba47ebe1401849b8 2023-11-11 11:53:56,894 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/7bc55d52e3fe4923ba47ebe1401849b8 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/7bc55d52e3fe4923ba47ebe1401849b8 2023-11-11 11:53:56,899 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/7bc55d52e3fe4923ba47ebe1401849b8, entries=1, sequenceid=33, filesize=4.9 K 2023-11-11 11:53:56,900 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 in 831ms, sequenceid=33, compaction requested=true 2023-11-11 11:53:56,900 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:53:56,900 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:56,901 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:56,901 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:56,901 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,901 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:53:56,901 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:53:56,902 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,902 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:56,903 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,903 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:56,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:56,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:53:56,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64f511ee[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:56,904 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:56,904 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,906 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,906 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:56,906 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:53:56,906 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,906 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:56,906 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:56,907 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,907 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:53:56,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:56,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:56,907 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:56,907 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:53:56,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:56,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:56,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:56,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:56,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:56,910 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:53:56,910 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:56,910 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:56,910 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,910 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:56,912 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,912 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:56,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,912 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:56,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:56,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:56,913 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,914 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:56,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,916 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,917 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,917 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:56,917 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:56,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:56,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:56,917 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:56,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-11 11:53:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:56,917 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:56,917 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:56,917 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:56,917 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:56,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:56,917 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,917 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:56,918 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,017 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:57,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:57,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:57,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:57,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,024 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:57,024 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:57,024 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:53:57,024 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:57,025 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,025 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,026 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,026 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:57,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:57,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:57,026 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,026 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:57,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:57,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,027 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,027 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:53:57,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,028 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:53:57,028 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:57,028 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:53:57,028 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:57,028 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:57,028 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:57,028 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. started... 2023-11-11 11:53:57,028 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a6a122edb2f0f032fe6b9e6c8ec2ec5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:57,441 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907d3d1a9efa9c84c11aa6cc843c642b82d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907d3d1a9efa9c84c11aa6cc843c642b82d 2023-11-11 11:53:57,847 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/444d8f7f8aba434ab76a835336265260 2023-11-11 11:53:57,853 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/444d8f7f8aba434ab76a835336265260 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/444d8f7f8aba434ab76a835336265260 2023-11-11 11:53:57,858 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/444d8f7f8aba434ab76a835336265260, entries=1, sequenceid=37, filesize=4.9 K 2023-11-11 11:53:57,859 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 in 831ms, sequenceid=37, compaction requested=true 2023-11-11 11:53:57,859 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:53:57,859 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:57,859 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:57,859 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:57,859 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,859 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:53:57,859 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:53:57,860 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,861 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:57,861 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,861 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:57,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:57,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:53:57,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a6f1937[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:57,863 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:57,863 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,865 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,865 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:57,865 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:53:57,865 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:57,865 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,866 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:57,867 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,867 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:53:57,867 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:57,867 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:53:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:57,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:57,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:57,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:57,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:57,870 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:53:57,870 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:57,870 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:57,870 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,870 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:57,871 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,871 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:57,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,871 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:57,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:57,872 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,873 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:57,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:57,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:57,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:57,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:57,876 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:57,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:57,876 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:57,876 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:57,977 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:57,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:57,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:53:57,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:53:57,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,983 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:57,983 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:57,984 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:53:57,984 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:53:57,984 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,984 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,986 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:57,986 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:57,987 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:57,987 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:53:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:53:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,988 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,988 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:53:57,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:57,988 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:53:57,988 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:53:57,988 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:53:57,989 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:53:57,989 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:53:57,989 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:57,989 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. started... 2023-11-11 11:53:57,989 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a6a122edb2f0f032fe6b9e6c8ec2ec5 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:53:58,403 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120145b5a22cd87429c83b310a3236158a0 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120145b5a22cd87429c83b310a3236158a0 2023-11-11 11:53:58,809 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/abfe2dd478f942f4b6d0dd13abcd527a 2023-11-11 11:53:58,814 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/abfe2dd478f942f4b6d0dd13abcd527a as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/abfe2dd478f942f4b6d0dd13abcd527a 2023-11-11 11:53:58,819 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/abfe2dd478f942f4b6d0dd13abcd527a, entries=1, sequenceid=41, filesize=4.9 K 2023-11-11 11:53:58,820 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 in 831ms, sequenceid=41, compaction requested=true 2023-11-11 11:53:58,820 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:53:58,820 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:58,820 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:53:58,820 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:53:58,820 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,820 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:53:58,820 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:53:58,822 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,822 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:58,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:58,822 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,823 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:53:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:58,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:53:58,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b1d7443[Count = 0] remaining members to acquire global barrier 2023-11-11 11:53:58,824 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:53:58,824 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,828 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,828 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:53:58,829 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:53:58,829 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:53:58,829 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,829 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:53:58,830 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,830 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:53:58,831 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:58,831 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:53:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:58,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:58,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:53:58,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:53:58,833 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:53:58,833 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:53:58,833 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:53:58,833 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,833 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:53:58,835 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,835 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:53:58,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:53:58,835 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:58,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:53:58,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:58,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:58,836 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:53:58,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,837 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:53:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,839 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,839 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:53:58,839 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:53:58,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:53:58,839 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:53:58,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-11 11:53:58,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:53:58,839 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,839 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:53:58,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:53:58,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:53:58,839 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:53:58,840 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:53:58,840 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,840 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:53:58,840 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,840 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,940 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:53:58,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:53:58,942 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-11 11:53:58,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 11:53:58,944 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 11:53:58,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:53:58,945 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704238945 2023-11-11 11:53:58,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-11 11:53:58,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-11 11:53:58,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 11:53:58,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x7bad3bae to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:53:58,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b2b02f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:53:58,954 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:53:59,792 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103badcc6f69a8a4bc59e02c96820497f3f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103badcc6f69a8a4bc59e02c96820497f3f 2023-11-11 11:53:59,794 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 11:53:59,807 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:53:59,808 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:53:59,815 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:53:59,816 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:53:59,825 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cf954e93f60d440eab7022412de9d200 first=Optional[r3] last=Optional[r6] 2023-11-11 11:53:59,825 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cf954e93f60d440eab7022412de9d200}] 2023-11-11 11:53:59,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cf954e93f60d440eab7022412de9d200 for inclusion in 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 2023-11-11 11:53:59,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-11 11:53:59,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:53:59,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:53:59,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cf954e93f60d440eab7022412de9d200 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1e99ma40dpilicuhoquge20ms5ob9usr6ppv7mrk7dpo1kq1071chcku08k5bdsd/family1/cf954e93f60d440eab7022412de9d200 2023-11-11 11:53:59,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1e99ma40dpilicuhoquge20ms5ob9usr6ppv7mrk7dpo1kq1071chcku08k5bdsd/family1/cf954e93f60d440eab7022412de9d200 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/37886e18f75a41ef93fddb00ee64574c_SeqId_44_ 2023-11-11 11:53:59,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1e99ma40dpilicuhoquge20ms5ob9usr6ppv7mrk7dpo1kq1071chcku08k5bdsd/family1/cf954e93f60d440eab7022412de9d200 into 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/37886e18f75a41ef93fddb00ee64574c_SeqId_44_ - updating store file list. 2023-11-11 11:53:59,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/37886e18f75a41ef93fddb00ee64574c_SeqId_44_ into 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 2023-11-11 11:53:59,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1e99ma40dpilicuhoquge20ms5ob9usr6ppv7mrk7dpo1kq1071chcku08k5bdsd/family1/cf954e93f60d440eab7022412de9d200 into 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/37886e18f75a41ef93fddb00ee64574c_SeqId_44_) 2023-11-11 11:53:59,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1e99ma40dpilicuhoquge20ms5ob9usr6ppv7mrk7dpo1kq1071chcku08k5bdsd/family1/cf954e93f60d440eab7022412de9d200 2023-11-11 11:53:59,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 11:53:59,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 11:53:59,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(1912): 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 is initiating minor compaction 2023-11-11 11:53:59,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@dd8a251; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:53:59,846 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 in testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:53:59,846 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/62ec3b629e1d4a97bc0099cebd872cc9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/34875b113f164b869f04d5e73caad7a8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/98dc1feba9dc4de0887189f675643d2d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/ac571869ce1241529a212662b4278e01, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/99cb39319fb94b218be31b1b907fbb69, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/9e374b67fa924e3e901fc85d83b6a6ed, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/7bc55d52e3fe4923ba47ebe1401849b8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/444d8f7f8aba434ab76a835336265260, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/abfe2dd478f942f4b6d0dd13abcd527a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/37886e18f75a41ef93fddb00ee64574c_SeqId_44_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp, totalSize=50.0 K 2023-11-11 11:53:59,846 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 62ec3b629e1d4a97bc0099cebd872cc9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 11:53:59,846 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 34875b113f164b869f04d5e73caad7a8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 11:53:59,846 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 98dc1feba9dc4de0887189f675643d2d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 11:53:59,847 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting ac571869ce1241529a212662b4278e01, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 11:53:59,847 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 99cb39319fb94b218be31b1b907fbb69, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 11:53:59,847 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 9e374b67fa924e3e901fc85d83b6a6ed, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 11:53:59,847 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 7bc55d52e3fe4923ba47ebe1401849b8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 11:53:59,847 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 444d8f7f8aba434ab76a835336265260, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 11:53:59,847 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting abfe2dd478f942f4b6d0dd13abcd527a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 11:53:59,847 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 37886e18f75a41ef93fddb00ee64574c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 11:53:59,848 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 11:53:59,850 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:53:59,852 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228a27e2296ccb94fb9bdf451f6dff4bf92 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228a27e2296ccb94fb9bdf451f6dff4bf92 2023-11-11 11:53:59,853 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512314eb296ee02ca4ea0a4a0b7e1187f8f67 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512314eb296ee02ca4ea0a4a0b7e1187f8f67 2023-11-11 11:53:59,854 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101c4184988d0184023aee974d6c9060424 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101c4184988d0184023aee974d6c9060424 2023-11-11 11:53:59,856 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010343215f937dda43b0a596a69a4c58e20b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010343215f937dda43b0a596a69a4c58e20b 2023-11-11 11:53:59,856 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-11 11:53:59,856 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-11 11:53:59,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:53:59,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:53:59,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:53:59,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:53:59,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:53:59,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:53:59,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:53:59,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:53:59,884 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4a6a122edb2f0f032fe6b9e6c8ec2ec5#family1#compaction#34 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:54:00,694 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c6bcf15613894329a7b28d5babd63aa5 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205c6bcf15613894329a7b28d5babd63aa5 2023-11-11 11:54:00,695 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 11:54:00,699 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/783679c2324444249988f76a2514c860 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/783679c2324444249988f76a2514c860 2023-11-11 11:54:00,705 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 of 4a6a122edb2f0f032fe6b9e6c8ec2ec5 into 783679c2324444249988f76a2514c860(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:54:00,706 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:54:00,706 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699703639846; duration=0sec 2023-11-11 11:54:00,706 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:00,721 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fbe5d0f6b83547279e1efe04745e5c10 first=Optional[r1] last=Optional[r2] 2023-11-11 11:54:00,722 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fbe5d0f6b83547279e1efe04745e5c10}] 2023-11-11 11:54:00,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fbe5d0f6b83547279e1efe04745e5c10 for inclusion in 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 2023-11-11 11:54:00,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-11 11:54:00,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:54:00,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:54:00,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fbe5d0f6b83547279e1efe04745e5c10 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rl3mmb3dheppn3hpnebjtdv2tpsarmnkf8u0phbuvoo2l3bj63k8maq7man2rrq8/family1/fbe5d0f6b83547279e1efe04745e5c10 2023-11-11 11:54:00,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rl3mmb3dheppn3hpnebjtdv2tpsarmnkf8u0phbuvoo2l3bj63k8maq7man2rrq8/family1/fbe5d0f6b83547279e1efe04745e5c10 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/399bbb392ea34fd8aeaffa6cde1073bb_SeqId_47_ 2023-11-11 11:54:00,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rl3mmb3dheppn3hpnebjtdv2tpsarmnkf8u0phbuvoo2l3bj63k8maq7man2rrq8/family1/fbe5d0f6b83547279e1efe04745e5c10 into 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/399bbb392ea34fd8aeaffa6cde1073bb_SeqId_47_ - updating store file list. 2023-11-11 11:54:00,746 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/62ec3b629e1d4a97bc0099cebd872cc9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/34875b113f164b869f04d5e73caad7a8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/98dc1feba9dc4de0887189f675643d2d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/ac571869ce1241529a212662b4278e01, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/99cb39319fb94b218be31b1b907fbb69, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/9e374b67fa924e3e901fc85d83b6a6ed, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/7bc55d52e3fe4923ba47ebe1401849b8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/444d8f7f8aba434ab76a835336265260, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/abfe2dd478f942f4b6d0dd13abcd527a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/37886e18f75a41ef93fddb00ee64574c_SeqId_44_] to archive 2023-11-11 11:54:00,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:00,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/399bbb392ea34fd8aeaffa6cde1073bb_SeqId_47_ into 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 2023-11-11 11:54:00,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rl3mmb3dheppn3hpnebjtdv2tpsarmnkf8u0phbuvoo2l3bj63k8maq7man2rrq8/family1/fbe5d0f6b83547279e1efe04745e5c10 into 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/399bbb392ea34fd8aeaffa6cde1073bb_SeqId_47_) 2023-11-11 11:54:00,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rl3mmb3dheppn3hpnebjtdv2tpsarmnkf8u0phbuvoo2l3bj63k8maq7man2rrq8/family1/fbe5d0f6b83547279e1efe04745e5c10 2023-11-11 11:54:00,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-11 11:54:00,749 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/62ec3b629e1d4a97bc0099cebd872cc9 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/62ec3b629e1d4a97bc0099cebd872cc9 2023-11-11 11:54:00,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-11 11:54:00,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(1912): 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 is initiating minor compaction (all files) 2023-11-11 11:54:00,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5c2c9729; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:00,749 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 in testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:54:00,750 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/71f556278b594d72a42efcd223bb71cd, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/783679c2324444249988f76a2514c860, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/399bbb392ea34fd8aeaffa6cde1073bb_SeqId_47_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp, totalSize=176.8 K 2023-11-11 11:54:00,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/34875b113f164b869f04d5e73caad7a8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/34875b113f164b869f04d5e73caad7a8 2023-11-11 11:54:00,750 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 71f556278b594d72a42efcd223bb71cd, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824916 2023-11-11 11:54:00,751 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 783679c2324444249988f76a2514c860, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224916 2023-11-11 11:54:00,751 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 399bbb392ea34fd8aeaffa6cde1073bb_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965224916 2023-11-11 11:54:00,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 11:54:00,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/98dc1feba9dc4de0887189f675643d2d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/98dc1feba9dc4de0887189f675643d2d 2023-11-11 11:54:00,752 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:00,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/ac571869ce1241529a212662b4278e01 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/ac571869ce1241529a212662b4278e01 2023-11-11 11:54:00,754 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512018dc65455719845aca5eb099390f6b083 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512018dc65455719845aca5eb099390f6b083 2023-11-11 11:54:00,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/99cb39319fb94b218be31b1b907fbb69 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/99cb39319fb94b218be31b1b907fbb69 2023-11-11 11:54:00,756 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205f5d065033f97463b8c3d72e176c53ce8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205f5d065033f97463b8c3d72e176c53ce8 2023-11-11 11:54:00,756 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-11 11:54:00,756 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-11 11:54:00,757 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:54:00,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 11:54:00,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:00,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/9e374b67fa924e3e901fc85d83b6a6ed to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/9e374b67fa924e3e901fc85d83b6a6ed 2023-11-11 11:54:00,759 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 11:54:00,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/7bc55d52e3fe4923ba47ebe1401849b8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/7bc55d52e3fe4923ba47ebe1401849b8 2023-11-11 11:54:00,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8160 sec 2023-11-11 11:54:00,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/444d8f7f8aba434ab76a835336265260 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/444d8f7f8aba434ab76a835336265260 2023-11-11 11:54:00,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/abfe2dd478f942f4b6d0dd13abcd527a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/abfe2dd478f942f4b6d0dd13abcd527a 2023-11-11 11:54:00,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/37886e18f75a41ef93fddb00ee64574c_SeqId_44_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/37886e18f75a41ef93fddb00ee64574c_SeqId_44_ 2023-11-11 11:54:00,774 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4a6a122edb2f0f032fe6b9e6c8ec2ec5#family1#compaction#35 average throughput is 15.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:54:00,857 INFO [Listener at localhost/39241] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=262 (was 265), OpenFileDescriptor=644 (was 644), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=241 (was 247), ProcessCount=170 (was 170), AvailableMemoryMB=2230 (was 2431) 2023-11-11 11:54:00,868 INFO [Listener at localhost/39241] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=262, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=241, ProcessCount=170, AvailableMemoryMB=2230 2023-11-11 11:54:00,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-11 11:54:00,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:00,873 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 11:54:00,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-11 11:54:00,874 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 11:54:00,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-11 11:54:00,876 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/422a7de28554bf253a37f6e26541befc 2023-11-11 11:54:00,876 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6903cfa11da17a1f47f8b48bb6976d76 2023-11-11 11:54:00,876 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd 2023-11-11 11:54:00,877 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/422a7de28554bf253a37f6e26541befc empty. 2023-11-11 11:54:00,877 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6903cfa11da17a1f47f8b48bb6976d76 empty. 2023-11-11 11:54:00,877 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd empty. 2023-11-11 11:54:00,877 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/422a7de28554bf253a37f6e26541befc 2023-11-11 11:54:00,877 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/6903cfa11da17a1f47f8b48bb6976d76 2023-11-11 11:54:00,877 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd 2023-11-11 11:54:00,877 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-11 11:54:00,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-11 11:54:01,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-11 11:54:01,285 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-11 11:54:01,286 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 422a7de28554bf253a37f6e26541befc, NAME => 'testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:54:01,287 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 4f7134a0327c0d6a8485919c75653ebd, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:54:01,287 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6903cfa11da17a1f47f8b48bb6976d76, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:54:01,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-11 11:54:01,694 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:01,694 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 422a7de28554bf253a37f6e26541befc, disabling compactions & flushes 2023-11-11 11:54:01,694 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:54:01,694 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:54:01,694 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. after waiting 0 ms 2023-11-11 11:54:01,694 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:54:01,694 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:54:01,694 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 422a7de28554bf253a37f6e26541befc: 2023-11-11 11:54:01,698 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:01,698 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 6903cfa11da17a1f47f8b48bb6976d76, disabling compactions & flushes 2023-11-11 11:54:01,698 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:54:01,698 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:54:01,698 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. after waiting 0 ms 2023-11-11 11:54:01,698 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:54:01,698 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:54:01,698 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 6903cfa11da17a1f47f8b48bb6976d76: 2023-11-11 11:54:01,702 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:01,702 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 4f7134a0327c0d6a8485919c75653ebd, disabling compactions & flushes 2023-11-11 11:54:01,702 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:54:01,702 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:54:01,703 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. after waiting 0 ms 2023-11-11 11:54:01,703 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:54:01,703 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:54:01,703 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 4f7134a0327c0d6a8485919c75653ebd: 2023-11-11 11:54:01,705 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 11:54:01,706 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699703641706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703641706"}]},"ts":"1699703641706"} 2023-11-11 11:54:01,706 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699703641706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703641706"}]},"ts":"1699703641706"} 2023-11-11 11:54:01,706 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699703641706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703641706"}]},"ts":"1699703641706"} 2023-11-11 11:54:01,709 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-11 11:54:01,710 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 11:54:01,710 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703641710"}]},"ts":"1699703641710"} 2023-11-11 11:54:01,711 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-11 11:54:01,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=422a7de28554bf253a37f6e26541befc, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6903cfa11da17a1f47f8b48bb6976d76, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4f7134a0327c0d6a8485919c75653ebd, ASSIGN}] 2023-11-11 11:54:01,717 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4f7134a0327c0d6a8485919c75653ebd, ASSIGN 2023-11-11 11:54:01,717 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6903cfa11da17a1f47f8b48bb6976d76, ASSIGN 2023-11-11 11:54:01,717 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=422a7de28554bf253a37f6e26541befc, ASSIGN 2023-11-11 11:54:01,718 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4f7134a0327c0d6a8485919c75653ebd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:54:01,718 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=422a7de28554bf253a37f6e26541befc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:54:01,718 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6903cfa11da17a1f47f8b48bb6976d76, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:54:01,869 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6903cfa11da17a1f47f8b48bb6976d76, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:01,869 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=4f7134a0327c0d6a8485919c75653ebd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:01,869 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=422a7de28554bf253a37f6e26541befc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:01,870 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699703641869"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703641869"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703641869"}]},"ts":"1699703641869"} 2023-11-11 11:54:01,870 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699703641869"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703641869"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703641869"}]},"ts":"1699703641869"} 2023-11-11 11:54:01,870 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699703641869"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703641869"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703641869"}]},"ts":"1699703641869"} 2023-11-11 11:54:01,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 6903cfa11da17a1f47f8b48bb6976d76, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:01,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 4f7134a0327c0d6a8485919c75653ebd, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:01,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure 422a7de28554bf253a37f6e26541befc, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:01,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-11 11:54:02,002 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/.tmp/family1/db158486e8384af299ef76727b2205f0 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/db158486e8384af299ef76727b2205f0 2023-11-11 11:54:02,007 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1 of 4a6a122edb2f0f032fe6b9e6c8ec2ec5 into db158486e8384af299ef76727b2205f0(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:54:02,008 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:54:02,008 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1699703640749; duration=1sec 2023-11-11 11:54:02,008 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:02,023 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:02,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:54:02,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6903cfa11da17a1f47f8b48bb6976d76, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76.', STARTKEY => '1', ENDKEY => '2'} 2023-11-11 11:54:02,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 6903cfa11da17a1f47f8b48bb6976d76 2023-11-11 11:54:02,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:02,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6903cfa11da17a1f47f8b48bb6976d76 2023-11-11 11:54:02,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6903cfa11da17a1f47f8b48bb6976d76 2023-11-11 11:54:02,028 INFO [StoreOpener-6903cfa11da17a1f47f8b48bb6976d76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6903cfa11da17a1f47f8b48bb6976d76 2023-11-11 11:54:02,029 DEBUG [StoreOpener-6903cfa11da17a1f47f8b48bb6976d76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/6903cfa11da17a1f47f8b48bb6976d76/family1 2023-11-11 11:54:02,029 DEBUG [StoreOpener-6903cfa11da17a1f47f8b48bb6976d76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/6903cfa11da17a1f47f8b48bb6976d76/family1 2023-11-11 11:54:02,030 INFO [StoreOpener-6903cfa11da17a1f47f8b48bb6976d76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6903cfa11da17a1f47f8b48bb6976d76 columnFamilyName family1 2023-11-11 11:54:02,031 INFO [StoreOpener-6903cfa11da17a1f47f8b48bb6976d76-1] regionserver.HStore(310): Store=6903cfa11da17a1f47f8b48bb6976d76/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:02,032 INFO [StoreOpener-6903cfa11da17a1f47f8b48bb6976d76-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6903cfa11da17a1f47f8b48bb6976d76 2023-11-11 11:54:02,033 DEBUG [StoreOpener-6903cfa11da17a1f47f8b48bb6976d76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/6903cfa11da17a1f47f8b48bb6976d76/family2 2023-11-11 11:54:02,033 DEBUG [StoreOpener-6903cfa11da17a1f47f8b48bb6976d76-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/6903cfa11da17a1f47f8b48bb6976d76/family2 2023-11-11 11:54:02,034 INFO [StoreOpener-6903cfa11da17a1f47f8b48bb6976d76-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6903cfa11da17a1f47f8b48bb6976d76 columnFamilyName family2 2023-11-11 11:54:02,035 INFO [StoreOpener-6903cfa11da17a1f47f8b48bb6976d76-1] regionserver.HStore(310): Store=6903cfa11da17a1f47f8b48bb6976d76/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:02,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/6903cfa11da17a1f47f8b48bb6976d76 2023-11-11 11:54:02,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/6903cfa11da17a1f47f8b48bb6976d76 2023-11-11 11:54:02,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:54:02,042 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/71f556278b594d72a42efcd223bb71cd, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/783679c2324444249988f76a2514c860, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/399bbb392ea34fd8aeaffa6cde1073bb_SeqId_47_] to archive 2023-11-11 11:54:02,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6903cfa11da17a1f47f8b48bb6976d76 2023-11-11 11:54:02,043 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:02,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/6903cfa11da17a1f47f8b48bb6976d76/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:54:02,045 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/71f556278b594d72a42efcd223bb71cd to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/71f556278b594d72a42efcd223bb71cd 2023-11-11 11:54:02,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6903cfa11da17a1f47f8b48bb6976d76; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64625420, jitterRate=-0.0370061993598938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:54:02,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6903cfa11da17a1f47f8b48bb6976d76: 2023-11-11 11:54:02,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76., pid=31, masterSystemTime=1699703642023 2023-11-11 11:54:02,046 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/783679c2324444249988f76a2514c860 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/783679c2324444249988f76a2514c860 2023-11-11 11:54:02,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:54:02,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/399bbb392ea34fd8aeaffa6cde1073bb_SeqId_47_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/family1/399bbb392ea34fd8aeaffa6cde1073bb_SeqId_47_ 2023-11-11 11:54:02,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:54:02,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:54:02,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 422a7de28554bf253a37f6e26541befc, NAME => 'testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc.', STARTKEY => '', ENDKEY => '1'} 2023-11-11 11:54:02,048 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6903cfa11da17a1f47f8b48bb6976d76, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:02,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 422a7de28554bf253a37f6e26541befc 2023-11-11 11:54:02,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:02,048 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699703642048"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703642048"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703642048"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703642048"}]},"ts":"1699703642048"} 2023-11-11 11:54:02,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 422a7de28554bf253a37f6e26541befc 2023-11-11 11:54:02,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 422a7de28554bf253a37f6e26541befc 2023-11-11 11:54:02,050 INFO [StoreOpener-422a7de28554bf253a37f6e26541befc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 422a7de28554bf253a37f6e26541befc 2023-11-11 11:54:02,051 DEBUG [StoreOpener-422a7de28554bf253a37f6e26541befc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/422a7de28554bf253a37f6e26541befc/family1 2023-11-11 11:54:02,051 DEBUG [StoreOpener-422a7de28554bf253a37f6e26541befc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/422a7de28554bf253a37f6e26541befc/family1 2023-11-11 11:54:02,052 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-11-11 11:54:02,052 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 6903cfa11da17a1f47f8b48bb6976d76, server=jenkins-hbase4.apache.org,41363,1699703601801 in 179 msec 2023-11-11 11:54:02,052 INFO [StoreOpener-422a7de28554bf253a37f6e26541befc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 422a7de28554bf253a37f6e26541befc columnFamilyName family1 2023-11-11 11:54:02,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=6903cfa11da17a1f47f8b48bb6976d76, ASSIGN in 337 msec 2023-11-11 11:54:02,053 INFO [StoreOpener-422a7de28554bf253a37f6e26541befc-1] regionserver.HStore(310): Store=422a7de28554bf253a37f6e26541befc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:02,054 INFO [StoreOpener-422a7de28554bf253a37f6e26541befc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 422a7de28554bf253a37f6e26541befc 2023-11-11 11:54:02,055 DEBUG [StoreOpener-422a7de28554bf253a37f6e26541befc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/422a7de28554bf253a37f6e26541befc/family2 2023-11-11 11:54:02,055 DEBUG [StoreOpener-422a7de28554bf253a37f6e26541befc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/422a7de28554bf253a37f6e26541befc/family2 2023-11-11 11:54:02,056 INFO [StoreOpener-422a7de28554bf253a37f6e26541befc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 422a7de28554bf253a37f6e26541befc columnFamilyName family2 2023-11-11 11:54:02,057 INFO [StoreOpener-422a7de28554bf253a37f6e26541befc-1] regionserver.HStore(310): Store=422a7de28554bf253a37f6e26541befc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:02,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/422a7de28554bf253a37f6e26541befc 2023-11-11 11:54:02,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/422a7de28554bf253a37f6e26541befc 2023-11-11 11:54:02,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:54:02,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 422a7de28554bf253a37f6e26541befc 2023-11-11 11:54:02,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/422a7de28554bf253a37f6e26541befc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:54:02,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 422a7de28554bf253a37f6e26541befc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64777608, jitterRate=-0.03473842144012451}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:54:02,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 422a7de28554bf253a37f6e26541befc: 2023-11-11 11:54:02,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc., pid=33, masterSystemTime=1699703642023 2023-11-11 11:54:02,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:54:02,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:54:02,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:54:02,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4f7134a0327c0d6a8485919c75653ebd, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd.', STARTKEY => '2', ENDKEY => ''} 2023-11-11 11:54:02,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 4f7134a0327c0d6a8485919c75653ebd 2023-11-11 11:54:02,068 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=422a7de28554bf253a37f6e26541befc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:02,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:02,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4f7134a0327c0d6a8485919c75653ebd 2023-11-11 11:54:02,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4f7134a0327c0d6a8485919c75653ebd 2023-11-11 11:54:02,068 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699703642068"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703642068"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703642068"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703642068"}]},"ts":"1699703642068"} 2023-11-11 11:54:02,070 INFO [StoreOpener-4f7134a0327c0d6a8485919c75653ebd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4f7134a0327c0d6a8485919c75653ebd 2023-11-11 11:54:02,071 DEBUG [StoreOpener-4f7134a0327c0d6a8485919c75653ebd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1 2023-11-11 11:54:02,071 DEBUG [StoreOpener-4f7134a0327c0d6a8485919c75653ebd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1 2023-11-11 11:54:02,072 INFO [StoreOpener-4f7134a0327c0d6a8485919c75653ebd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f7134a0327c0d6a8485919c75653ebd columnFamilyName family1 2023-11-11 11:54:02,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=28 2023-11-11 11:54:02,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure 422a7de28554bf253a37f6e26541befc, server=jenkins-hbase4.apache.org,41363,1699703601801 in 197 msec 2023-11-11 11:54:02,073 INFO [StoreOpener-4f7134a0327c0d6a8485919c75653ebd-1] regionserver.HStore(310): Store=4f7134a0327c0d6a8485919c75653ebd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:02,073 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=422a7de28554bf253a37f6e26541befc, ASSIGN in 357 msec 2023-11-11 11:54:02,073 INFO [StoreOpener-4f7134a0327c0d6a8485919c75653ebd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4f7134a0327c0d6a8485919c75653ebd 2023-11-11 11:54:02,075 DEBUG [StoreOpener-4f7134a0327c0d6a8485919c75653ebd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family2 2023-11-11 11:54:02,075 DEBUG [StoreOpener-4f7134a0327c0d6a8485919c75653ebd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family2 2023-11-11 11:54:02,076 INFO [StoreOpener-4f7134a0327c0d6a8485919c75653ebd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f7134a0327c0d6a8485919c75653ebd columnFamilyName family2 2023-11-11 11:54:02,077 INFO [StoreOpener-4f7134a0327c0d6a8485919c75653ebd-1] regionserver.HStore(310): Store=4f7134a0327c0d6a8485919c75653ebd/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:02,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd 2023-11-11 11:54:02,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd 2023-11-11 11:54:02,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:54:02,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4f7134a0327c0d6a8485919c75653ebd 2023-11-11 11:54:02,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:54:02,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4f7134a0327c0d6a8485919c75653ebd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63711661, jitterRate=-0.05062226951122284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:54:02,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4f7134a0327c0d6a8485919c75653ebd: 2023-11-11 11:54:02,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd., pid=32, masterSystemTime=1699703642023 2023-11-11 11:54:02,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:54:02,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:54:02,088 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=4f7134a0327c0d6a8485919c75653ebd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:02,088 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699703642087"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703642087"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703642087"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703642087"}]},"ts":"1699703642087"} 2023-11-11 11:54:02,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=30 2023-11-11 11:54:02,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 4f7134a0327c0d6a8485919c75653ebd, server=jenkins-hbase4.apache.org,41363,1699703601801 in 217 msec 2023-11-11 11:54:02,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=27 2023-11-11 11:54:02,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4f7134a0327c0d6a8485919c75653ebd, ASSIGN in 376 msec 2023-11-11 11:54:02,094 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 11:54:02,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703642094"}]},"ts":"1699703642094"} 2023-11-11 11:54:02,095 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-11 11:54:02,098 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 11:54:02,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2270 sec 2023-11-11 11:54:02,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-11 11:54:02,979 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-11 11:54:02,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:02,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:02,988 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-11 11:54:02,988 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:02,988 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-11 11:54:02,988 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-11 11:54:02,989 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:02,989 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:02,990 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:02,990 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:02,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:02,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:02,991 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:02,991 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:02,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:02,991 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:02,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:02,992 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-11 11:54:02,992 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:02,992 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-11 11:54:02,992 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:54:02,992 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. started... 2023-11-11 11:54:02,992 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:54:02,992 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:02,993 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4f7134a0327c0d6a8485919c75653ebd 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-11 11:54:02,992 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:54:02,993 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:54:02,993 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. started... 2023-11-11 11:54:02,993 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. started... 2023-11-11 11:54:02,994 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 6903cfa11da17a1f47f8b48bb6976d76: 2023-11-11 11:54:02,994 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 422a7de28554bf253a37f6e26541befc: 2023-11-11 11:54:02,994 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:54:02,994 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:54:02,994 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:54:02,994 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:54:03,408 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311119720b6f019c643a5a1c528f783824a36 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311119720b6f019c643a5a1c528f783824a36 2023-11-11 11:54:03,814 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/.tmp/family1/c8f3a41f80584964ad1c9e839192120f 2023-11-11 11:54:03,819 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/.tmp/family1/c8f3a41f80584964ad1c9e839192120f as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/c8f3a41f80584964ad1c9e839192120f 2023-11-11 11:54:03,823 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/c8f3a41f80584964ad1c9e839192120f, entries=1, sequenceid=5, filesize=4.9 K 2023-11-11 11:54:03,825 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 4f7134a0327c0d6a8485919c75653ebd in 832ms, sequenceid=5, compaction requested=false 2023-11-11 11:54:03,825 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-11 11:54:03,825 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4f7134a0327c0d6a8485919c75653ebd: 2023-11-11 11:54:03,825 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:54:03,826 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:54:03,826 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:54:03,826 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,826 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-11 11:54:03,826 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-11 11:54:03,827 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,827 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:03,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:03,828 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,828 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:03,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:03,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:03,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:03,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-11 11:54:03,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@664f0cf1[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:03,830 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-11 11:54:03,830 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,831 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,831 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-11 11:54:03,831 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-11 11:54:03,831 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:03,831 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,831 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:03,832 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-11 11:54:03,832 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,832 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:03,832 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-11 11:54:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:03,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:03,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-11 11:54:03,835 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-11 11:54:03,835 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:03,835 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:03,835 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,835 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:03,838 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,838 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:03,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,838 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:03,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:03,838 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,840 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,842 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,842 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,842 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,842 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:03,842 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,842 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:03,842 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-11 11:54:03,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:03,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:03,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:03,842 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:03,842 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,842 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,843 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:03,843 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:03,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:03,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:03,943 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:03,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:03,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:03,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:03,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,949 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-11 11:54:03,949 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:03,949 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-11 11:54:03,949 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-11 11:54:03,950 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,950 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,951 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,951 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:03,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:03,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:03,952 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:03,952 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,953 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,953 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-11 11:54:03,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:03,953 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-11 11:54:03,953 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:03,953 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-11 11:54:03,953 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:54:03,953 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:54:03,953 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:03,953 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:54:03,953 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. started... 2023-11-11 11:54:03,953 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:54:03,953 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. started... 2023-11-11 11:54:03,953 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4f7134a0327c0d6a8485919c75653ebd 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-11 11:54:03,953 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. started... 2023-11-11 11:54:03,954 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 422a7de28554bf253a37f6e26541befc: 2023-11-11 11:54:03,954 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:54:03,954 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 6903cfa11da17a1f47f8b48bb6976d76: 2023-11-11 11:54:03,954 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:54:03,954 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:54:03,954 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:54:04,367 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311119c3630bdc4f942bca61215c8c8553935 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311119c3630bdc4f942bca61215c8c8553935 2023-11-11 11:54:04,773 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/.tmp/family1/54360915c00142ddb05a8306ee706aa1 2023-11-11 11:54:04,778 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/.tmp/family1/54360915c00142ddb05a8306ee706aa1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/54360915c00142ddb05a8306ee706aa1 2023-11-11 11:54:04,782 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/54360915c00142ddb05a8306ee706aa1, entries=2, sequenceid=9, filesize=5.0 K 2023-11-11 11:54:04,783 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 4f7134a0327c0d6a8485919c75653ebd in 830ms, sequenceid=9, compaction requested=false 2023-11-11 11:54:04,783 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4f7134a0327c0d6a8485919c75653ebd: 2023-11-11 11:54:04,783 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:54:04,783 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:54:04,783 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:54:04,783 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,783 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-11 11:54:04,783 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-11 11:54:04,785 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,785 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:04,786 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,786 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:04,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-11 11:54:04,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a790bb7[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:04,787 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-11 11:54:04,787 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,790 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,790 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-11 11:54:04,790 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-11 11:54:04,790 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:04,790 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,790 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:04,791 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,791 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-11 11:54:04,791 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:04,791 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-11 11:54:04,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:04,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:04,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:04,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:04,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-11 11:54:04,794 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-11 11:54:04,795 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:04,795 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:04,795 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,795 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:04,797 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,797 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,797 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:04,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:04,797 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,799 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,805 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,805 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,805 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:04,805 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,805 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:04,805 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:04,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:04,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:04,805 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:04,805 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,805 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-11 11:54:04,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-11 11:54:04,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:04,805 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,806 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:04,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:04,806 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:04,806 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:04,906 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:04,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:04,913 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-11 11:54:04,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-11 11:54:04,916 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-11 11:54:04,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:04,917 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704244917 2023-11-11 11:54:04,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 11:54:04,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-11 11:54:04,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-11 11:54:04,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x6a136eac to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:54:04,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@599cc587, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:54:04,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231111 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-11 11:54:05,751 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311112fd1dc9fbc7e4aeeb758da03e50feee7 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311112fd1dc9fbc7e4aeeb758da03e50feee7 2023-11-11 11:54:05,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-11 11:54:05,768 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:54:05,769 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:54:05,775 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:54:05,777 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:54:05,786 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231111/family1/e09d6567ff9244ce9f86fac637cf440c first=Optional[k0] last=Optional[k1] 2023-11-11 11:54:05,786 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231111/family1/e09d6567ff9244ce9f86fac637cf440c}] 2023-11-11 11:54:05,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231111/family1/e09d6567ff9244ce9f86fac637cf440c for inclusion in 4f7134a0327c0d6a8485919c75653ebd/family1 2023-11-11 11:54:05,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-11 11:54:05,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-11 11:54:05,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 4f7134a0327c0d6a8485919c75653ebd: 2023-11-11 11:54:05,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231111/family1/e09d6567ff9244ce9f86fac637cf440c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testScannerOnBulkLoadRefHFiles__egt8g3mdnve05itheq3klbfsessctdgv4n662jc1ckam8b1t8ue1n0hp04r0j32e/family1/e09d6567ff9244ce9f86fac637cf440c 2023-11-11 11:54:05,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testScannerOnBulkLoadRefHFiles__egt8g3mdnve05itheq3klbfsessctdgv4n662jc1ckam8b1t8ue1n0hp04r0j32e/family1/e09d6567ff9244ce9f86fac637cf440c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/338657bff1cf40b39076e62844728217_SeqId_12_ 2023-11-11 11:54:05,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testScannerOnBulkLoadRefHFiles__egt8g3mdnve05itheq3klbfsessctdgv4n662jc1ckam8b1t8ue1n0hp04r0j32e/family1/e09d6567ff9244ce9f86fac637cf440c into 4f7134a0327c0d6a8485919c75653ebd/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/338657bff1cf40b39076e62844728217_SeqId_12_ - updating store file list. 2023-11-11 11:54:05,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/338657bff1cf40b39076e62844728217_SeqId_12_ into 4f7134a0327c0d6a8485919c75653ebd/family1 2023-11-11 11:54:05,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testScannerOnBulkLoadRefHFiles__egt8g3mdnve05itheq3klbfsessctdgv4n662jc1ckam8b1t8ue1n0hp04r0j32e/family1/e09d6567ff9244ce9f86fac637cf440c into 4f7134a0327c0d6a8485919c75653ebd/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/338657bff1cf40b39076e62844728217_SeqId_12_) 2023-11-11 11:54:05,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testScannerOnBulkLoadRefHFiles__egt8g3mdnve05itheq3klbfsessctdgv4n662jc1ckam8b1t8ue1n0hp04r0j32e/family1/e09d6567ff9244ce9f86fac637cf440c 2023-11-11 11:54:05,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-11 11:54:05,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-11 11:54:05,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(1912): 4f7134a0327c0d6a8485919c75653ebd/family1 is initiating minor compaction (all files) 2023-11-11 11:54:05,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@594b24ea; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:05,803 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4f7134a0327c0d6a8485919c75653ebd/family1 in testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:54:05,803 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/c8f3a41f80584964ad1c9e839192120f, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/54360915c00142ddb05a8306ee706aa1, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/338657bff1cf40b39076e62844728217_SeqId_12_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/.tmp, totalSize=15.1 K 2023-11-11 11:54:05,804 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting c8f3a41f80584964ad1c9e839192120f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703642979 2023-11-11 11:54:05,804 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 54360915c00142ddb05a8306ee706aa1, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703642979 2023-11-11 11:54:05,805 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 338657bff1cf40b39076e62844728217_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703642979 2023-11-11 11:54:05,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-11 11:54:05,806 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:05,808 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311119720b6f019c643a5a1c528f783824a36 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311119720b6f019c643a5a1c528f783824a36 2023-11-11 11:54:05,809 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311119c3630bdc4f942bca61215c8c8553935 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311119c3630bdc4f942bca61215c8c8553935 2023-11-11 11:54:05,809 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-11 11:54:05,809 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231111' 2023-11-11 11:54:05,810 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231111 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-11 11:54:05,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-11 11:54:05,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:05,811 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-11 11:54:05,812 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 897 msec 2023-11-11 11:54:05,815 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4f7134a0327c0d6a8485919c75653ebd#family1#compaction#38 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:54:05,845 INFO [Listener at localhost/39241] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=262 (was 262), OpenFileDescriptor=645 (was 644) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=245 (was 241) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=2190 (was 2230) 2023-11-11 11:54:05,856 INFO [Listener at localhost/39241] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=262, OpenFileDescriptor=645, MaxFileDescriptor=60000, SystemLoadAverage=245, ProcessCount=170, AvailableMemoryMB=2189 2023-11-11 11:54:05,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-11 11:54:05,879 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:54:05,879 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20f3b936 to 127.0.0.1:59344 2023-11-11 11:54:05,879 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:54:05,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:05,880 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:54:05,880 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x386c2d2e to 127.0.0.1:59344 2023-11-11 11:54:05,881 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:54:05,881 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:54:05,881 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e11b81a to 127.0.0.1:59344 2023-11-11 11:54:05,882 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:54:05,882 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 11:54:05,882 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:54:05,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-11 11:54:05,883 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a136eac to 127.0.0.1:59344 2023-11-11 11:54:05,883 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:54:05,883 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:54:05,883 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 11:54:05,883 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bad3bae to 127.0.0.1:59344 2023-11-11 11:54:05,884 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:54:05,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-11 11:54:05,885 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a 2023-11-11 11:54:05,886 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a empty. 2023-11-11 11:54:05,886 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a 2023-11-11 11:54:05,886 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-11 11:54:05,896 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-11 11:54:05,898 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => e83876f9f0be04ff0c4dd2585fadf76a, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:54:05,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-11 11:54:06,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-11 11:54:06,303 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:06,304 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing e83876f9f0be04ff0c4dd2585fadf76a, disabling compactions & flushes 2023-11-11 11:54:06,304 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:06,304 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:06,304 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. after waiting 0 ms 2023-11-11 11:54:06,304 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:06,304 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:06,304 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:06,306 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 11:54:06,307 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699703646307"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703646307"}]},"ts":"1699703646307"} 2023-11-11 11:54:06,308 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 11:54:06,309 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 11:54:06,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703646309"}]},"ts":"1699703646309"} 2023-11-11 11:54:06,310 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-11 11:54:06,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e83876f9f0be04ff0c4dd2585fadf76a, ASSIGN}] 2023-11-11 11:54:06,315 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e83876f9f0be04ff0c4dd2585fadf76a, ASSIGN 2023-11-11 11:54:06,315 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e83876f9f0be04ff0c4dd2585fadf76a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:54:06,466 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e83876f9f0be04ff0c4dd2585fadf76a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:06,466 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699703646466"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703646466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703646466"}]},"ts":"1699703646466"} 2023-11-11 11:54:06,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure e83876f9f0be04ff0c4dd2585fadf76a, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:06,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-11 11:54:06,620 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:06,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:06,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e83876f9f0be04ff0c4dd2585fadf76a, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:54:06,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy e83876f9f0be04ff0c4dd2585fadf76a 2023-11-11 11:54:06,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:06,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e83876f9f0be04ff0c4dd2585fadf76a 2023-11-11 11:54:06,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e83876f9f0be04ff0c4dd2585fadf76a 2023-11-11 11:54:06,624 INFO [StoreOpener-e83876f9f0be04ff0c4dd2585fadf76a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e83876f9f0be04ff0c4dd2585fadf76a 2023-11-11 11:54:06,626 DEBUG [StoreOpener-e83876f9f0be04ff0c4dd2585fadf76a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1 2023-11-11 11:54:06,626 DEBUG [StoreOpener-e83876f9f0be04ff0c4dd2585fadf76a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1 2023-11-11 11:54:06,626 INFO [StoreOpener-e83876f9f0be04ff0c4dd2585fadf76a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e83876f9f0be04ff0c4dd2585fadf76a columnFamilyName family1 2023-11-11 11:54:06,628 INFO [StoreOpener-e83876f9f0be04ff0c4dd2585fadf76a-1] regionserver.HStore(310): Store=e83876f9f0be04ff0c4dd2585fadf76a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:06,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a 2023-11-11 11:54:06,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a 2023-11-11 11:54:06,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e83876f9f0be04ff0c4dd2585fadf76a 2023-11-11 11:54:06,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:54:06,634 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/.tmp/family1/5e5421c4cd404bbaa997b43488d2fb64 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/5e5421c4cd404bbaa997b43488d2fb64 2023-11-11 11:54:06,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e83876f9f0be04ff0c4dd2585fadf76a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72924057, jitterRate=0.08665312826633453}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:54:06,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:06,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a., pid=37, masterSystemTime=1699703646620 2023-11-11 11:54:06,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:06,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:06,638 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e83876f9f0be04ff0c4dd2585fadf76a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:06,638 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699703646638"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703646638"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703646638"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703646638"}]},"ts":"1699703646638"} 2023-11-11 11:54:06,640 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4f7134a0327c0d6a8485919c75653ebd/family1 of 4f7134a0327c0d6a8485919c75653ebd into 5e5421c4cd404bbaa997b43488d2fb64(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:54:06,641 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4f7134a0327c0d6a8485919c75653ebd: 2023-11-11 11:54:06,641 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1699703645803; duration=0sec 2023-11-11 11:54:06,641 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:06,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-11 11:54:06,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure e83876f9f0be04ff0c4dd2585fadf76a, server=jenkins-hbase4.apache.org,41363,1699703601801 in 172 msec 2023-11-11 11:54:06,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-11 11:54:06,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e83876f9f0be04ff0c4dd2585fadf76a, ASSIGN in 329 msec 2023-11-11 11:54:06,645 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 11:54:06,645 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703646645"}]},"ts":"1699703646645"} 2023-11-11 11:54:06,646 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-11 11:54:06,649 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 11:54:06,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 771 msec 2023-11-11 11:54:06,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/c8f3a41f80584964ad1c9e839192120f, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/54360915c00142ddb05a8306ee706aa1, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/338657bff1cf40b39076e62844728217_SeqId_12_] to archive 2023-11-11 11:54:06,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:06,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/c8f3a41f80584964ad1c9e839192120f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/c8f3a41f80584964ad1c9e839192120f 2023-11-11 11:54:06,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/54360915c00142ddb05a8306ee706aa1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/54360915c00142ddb05a8306ee706aa1 2023-11-11 11:54:06,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/338657bff1cf40b39076e62844728217_SeqId_12_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/family1/338657bff1cf40b39076e62844728217_SeqId_12_ 2023-11-11 11:54:06,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-11 11:54:06,988 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-11 11:54:07,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:07,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,019 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:07,019 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:07,019 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:54:07,019 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:54:07,019 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,019 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,021 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:07,021 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:07,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:07,022 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,022 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:07,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,023 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,023 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,023 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:54:07,023 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:07,023 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:54:07,023 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:07,023 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:07,024 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:07,024 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. started... 2023-11-11 11:54:07,024 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e83876f9f0be04ff0c4dd2585fadf76a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 11:54:07,047 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130041dddfc434149bdbefd0d1b0b987188 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130041dddfc434149bdbefd0d1b0b987188 2023-11-11 11:54:07,051 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/7728e12a76c2495db683d12c1fb6f9b8 2023-11-11 11:54:07,056 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/7728e12a76c2495db683d12c1fb6f9b8 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/7728e12a76c2495db683d12c1fb6f9b8 2023-11-11 11:54:07,061 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/7728e12a76c2495db683d12c1fb6f9b8, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-11 11:54:07,062 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e83876f9f0be04ff0c4dd2585fadf76a in 38ms, sequenceid=5, compaction requested=false 2023-11-11 11:54:07,062 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:07,062 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:07,062 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:07,062 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:07,062 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:07,062 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,062 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:54:07,062 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:54:07,064 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,064 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:07,064 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,064 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:07,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:07,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:54:07,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18ed196e[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:07,066 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:54:07,066 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,067 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,067 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:54:07,068 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:54:07,068 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:07,068 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,068 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:07,069 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:54:07,069 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:07,069 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,069 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:54:07,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:07,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:07,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:07,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:54:07,071 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:54:07,071 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:07,071 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:07,071 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,072 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:07,074 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,074 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:07,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:07,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,074 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:07,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:07,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:07,075 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:07,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,076 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:07,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,078 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,078 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:07,078 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,078 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:07,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:07,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:07,078 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:07,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:07,079 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,079 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:07,079 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,079 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,079 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:07,079 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:07,079 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:07,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:07,179 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:07,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:07,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:07,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:07,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,185 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:07,185 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:07,186 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:54:07,186 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:54:07,186 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,186 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,187 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,187 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:07,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:07,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:07,187 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:07,188 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:07,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:07,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,188 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,189 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:54:07,189 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:07,189 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:54:07,189 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:07,189 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:54:07,189 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:07,189 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:07,189 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:07,189 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. started... 2023-11-11 11:54:07,189 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e83876f9f0be04ff0c4dd2585fadf76a 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 11:54:07,562 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 11:54:07,605 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282b9e82f983d142778c863d76e70bee1a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511282b9e82f983d142778c863d76e70bee1a 2023-11-11 11:54:08,011 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/410d43d95e1b42289515e4f79f7c86a8 2023-11-11 11:54:08,016 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/410d43d95e1b42289515e4f79f7c86a8 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/410d43d95e1b42289515e4f79f7c86a8 2023-11-11 11:54:08,020 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/410d43d95e1b42289515e4f79f7c86a8, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 11:54:08,021 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e83876f9f0be04ff0c4dd2585fadf76a in 832ms, sequenceid=9, compaction requested=false 2023-11-11 11:54:08,021 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:08,021 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:08,021 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:08,021 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:08,021 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,021 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:54:08,021 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:54:08,023 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,023 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:08,023 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,023 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:08,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:54:08,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78b2d95c[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:08,025 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:54:08,025 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,027 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,027 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:54:08,027 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:54:08,027 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:08,027 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,027 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:08,028 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,028 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:54:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:08,028 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:08,028 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:54:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:08,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:54:08,031 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:54:08,031 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:08,031 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:08,031 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,031 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:08,032 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,032 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,032 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:08,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:08,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:08,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:08,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:08,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:08,033 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,034 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:08,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,041 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,041 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,041 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:08,041 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:08,041 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,041 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:08,041 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:08,041 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,041 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:08,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:08,041 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:08,041 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:08,042 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:08,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:08,142 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:08,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:08,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:08,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:08,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,148 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:08,148 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:08,148 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:54:08,148 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:54:08,148 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,148 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,150 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,150 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:08,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:08,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:08,150 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,150 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:08,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:08,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,151 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,151 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:54:08,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,151 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:54:08,152 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:08,152 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:54:08,152 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:08,152 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:08,152 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:08,152 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. started... 2023-11-11 11:54:08,152 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e83876f9f0be04ff0c4dd2585fadf76a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:08,564 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201be7afb8c80774349837b7d8a54cf85d4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201be7afb8c80774349837b7d8a54cf85d4 2023-11-11 11:54:08,970 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/44f52113ad95447d98ba41e873f8b141 2023-11-11 11:54:08,975 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/44f52113ad95447d98ba41e873f8b141 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/44f52113ad95447d98ba41e873f8b141 2023-11-11 11:54:08,979 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/44f52113ad95447d98ba41e873f8b141, entries=1, sequenceid=13, filesize=4.9 K 2023-11-11 11:54:08,979 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e83876f9f0be04ff0c4dd2585fadf76a in 827ms, sequenceid=13, compaction requested=true 2023-11-11 11:54:08,980 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:08,980 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:08,980 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:08,980 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:08,980 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,980 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:54:08,980 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:54:08,982 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,982 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:08,982 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,982 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:08,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:08,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:08,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:54:08,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66047a3f[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:08,983 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:54:08,983 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,985 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,985 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:54:08,985 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:54:08,985 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:08,985 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,985 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:08,986 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,986 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:54:08,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:08,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:08,987 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:08,987 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:54:08,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:08,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:08,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:08,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:08,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:54:08,989 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:54:08,989 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:08,989 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:08,989 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,989 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:08,992 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,992 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:08,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,992 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:08,993 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:08,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:08,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:08,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,994 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:08,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,997 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,997 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,997 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:08,997 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,997 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:08,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:08,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:08,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:08,997 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:08,997 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:08,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:08,997 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,997 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,997 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:08,997 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:08,997 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:08,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:08,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:09,097 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:09,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:09,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:09,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:09,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,104 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:09,104 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:09,104 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:54:09,104 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:54:09,104 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,104 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,106 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,106 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:09,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:09,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:09,106 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,106 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:09,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:09,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,107 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,107 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:54:09,107 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,107 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:54:09,107 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:09,107 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:54:09,107 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:09,107 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:09,107 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:09,107 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. started... 2023-11-11 11:54:09,107 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e83876f9f0be04ff0c4dd2585fadf76a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:09,520 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056e246c0308314d1692fd537a15826ab7 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056e246c0308314d1692fd537a15826ab7 2023-11-11 11:54:09,925 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/79828d9940a94cd38c90da1587c52bc9 2023-11-11 11:54:09,930 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/79828d9940a94cd38c90da1587c52bc9 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/79828d9940a94cd38c90da1587c52bc9 2023-11-11 11:54:09,934 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/79828d9940a94cd38c90da1587c52bc9, entries=1, sequenceid=17, filesize=4.9 K 2023-11-11 11:54:09,935 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e83876f9f0be04ff0c4dd2585fadf76a in 828ms, sequenceid=17, compaction requested=true 2023-11-11 11:54:09,935 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:09,935 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:09,935 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:09,935 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:09,935 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,935 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:54:09,935 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:54:09,937 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,937 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:09,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:09,937 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,937 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:09,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:09,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:09,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:09,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:54:09,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@442f1fb[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:09,939 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:54:09,939 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,941 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,941 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:54:09,941 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:54:09,941 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:09,941 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,941 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:09,942 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:54:09,942 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:09,942 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,942 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:54:09,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:09,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:09,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:09,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:09,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:09,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:09,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:54:09,945 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:54:09,945 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:09,945 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:09,945 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,945 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:09,947 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,947 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:09,947 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:09,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:09,947 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:09,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,949 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:09,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,951 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,951 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,951 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,951 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:09,951 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:09,951 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:09,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:09,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:09,951 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:09,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:09,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:09,951 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,952 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,952 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:09,952 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:09,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:09,952 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:09,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:10,052 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:10,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:10,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:10,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:10,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,058 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:10,058 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:10,058 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:54:10,058 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:54:10,059 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,059 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,061 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:10,061 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:10,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:10,061 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,061 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:10,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:10,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,062 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,062 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:54:10,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,062 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:54:10,062 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:10,062 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:54:10,062 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:10,062 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:10,063 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:10,063 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. started... 2023-11-11 11:54:10,063 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e83876f9f0be04ff0c4dd2585fadf76a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:10,475 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228193d00f0fb5a4626ac64a8165c201da1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228193d00f0fb5a4626ac64a8165c201da1 2023-11-11 11:54:10,881 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/f3b2b0c19c6f4e8287e91da9af3bc5a4 2023-11-11 11:54:10,886 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/f3b2b0c19c6f4e8287e91da9af3bc5a4 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/f3b2b0c19c6f4e8287e91da9af3bc5a4 2023-11-11 11:54:10,889 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/f3b2b0c19c6f4e8287e91da9af3bc5a4, entries=1, sequenceid=21, filesize=4.9 K 2023-11-11 11:54:10,890 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e83876f9f0be04ff0c4dd2585fadf76a in 827ms, sequenceid=21, compaction requested=true 2023-11-11 11:54:10,890 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:10,890 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:10,890 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:10,890 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:10,891 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,891 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:54:10,891 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:54:10,892 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,892 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:10,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:10,893 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,893 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:10,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:10,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:10,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:10,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:54:10,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7494ae74[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:10,894 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:54:10,894 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,895 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,895 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:54:10,895 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:54:10,895 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:10,895 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,895 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:10,897 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,897 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:54:10,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:10,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:10,897 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:10,897 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:54:10,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:10,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:10,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:10,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:10,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:54:10,899 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:54:10,899 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:10,899 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:10,899 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,899 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:10,905 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,905 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,905 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:10,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:10,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:10,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:10,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:10,905 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:10,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:10,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,907 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:10,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,909 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,909 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,909 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,909 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:10,909 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,909 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,909 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:10,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:10,909 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:10,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:10,909 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:10,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:10,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:10,909 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:10,909 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:10,909 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:10,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-11 11:54:10,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:10,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:11,010 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:11,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:11,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:11,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:11,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,016 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:11,016 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:11,016 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:54:11,016 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:54:11,016 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,016 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,017 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,017 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:11,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:11,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:11,018 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,018 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,018 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,019 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:54:11,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,019 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:54:11,019 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:11,019 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:54:11,019 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:11,019 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:11,019 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:11,019 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. started... 2023-11-11 11:54:11,019 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e83876f9f0be04ff0c4dd2585fadf76a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:11,432 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ce3f682c4d5a4c85946ded83ffad73bb to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231ce3f682c4d5a4c85946ded83ffad73bb 2023-11-11 11:54:11,837 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/a295e4db34ac41d1b56b2b255a509413 2023-11-11 11:54:11,843 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/a295e4db34ac41d1b56b2b255a509413 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/a295e4db34ac41d1b56b2b255a509413 2023-11-11 11:54:11,847 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/a295e4db34ac41d1b56b2b255a509413, entries=1, sequenceid=25, filesize=4.9 K 2023-11-11 11:54:11,848 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e83876f9f0be04ff0c4dd2585fadf76a in 829ms, sequenceid=25, compaction requested=true 2023-11-11 11:54:11,848 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:11,848 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:11,848 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:11,848 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:11,848 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,848 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:54:11,848 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:54:11,850 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,850 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:11,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:11,851 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,851 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:11,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:11,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:11,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:11,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:54:11,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a02e183[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:11,852 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:54:11,852 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,855 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,855 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:54:11,855 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:54:11,855 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:11,855 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,855 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:11,857 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:54:11,857 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:11,857 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,857 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:54:11,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:11,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:11,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:11,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:11,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:11,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:11,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:54:11,859 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:54:11,859 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:11,859 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:11,859 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,860 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:11,861 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:11,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:11,861 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,861 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:11,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:11,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:11,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:11,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,862 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:11,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:11,863 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,866 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,866 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:11,866 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:11,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:11,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:11,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:11,866 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:11,866 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:11,866 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,866 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,866 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:11,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:11,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:11,866 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,866 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:11,866 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,867 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,967 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:11,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:11,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:11,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:11,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,973 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:11,973 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:11,973 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:54:11,973 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:54:11,973 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,973 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,975 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,975 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:11,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:11,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:11,976 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:11,976 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:11,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:11,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,976 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,977 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:54:11,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:11,977 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:54:11,977 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:11,977 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:54:11,977 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:11,977 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:11,977 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:11,977 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. started... 2023-11-11 11:54:11,977 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e83876f9f0be04ff0c4dd2585fadf76a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:12,391 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101400554d6e5484114b6e1f6617222a9c4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101400554d6e5484114b6e1f6617222a9c4 2023-11-11 11:54:12,796 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/8f36472bed0045d78f84d73923d4d794 2023-11-11 11:54:12,801 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/8f36472bed0045d78f84d73923d4d794 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/8f36472bed0045d78f84d73923d4d794 2023-11-11 11:54:12,805 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/8f36472bed0045d78f84d73923d4d794, entries=1, sequenceid=29, filesize=4.9 K 2023-11-11 11:54:12,805 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e83876f9f0be04ff0c4dd2585fadf76a in 828ms, sequenceid=29, compaction requested=true 2023-11-11 11:54:12,805 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:12,805 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:12,806 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:12,806 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:12,806 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,806 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:54:12,806 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:54:12,807 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,807 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:12,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:12,808 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,808 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:12,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:12,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:12,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:12,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:54:12,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f12a57e[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:12,809 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:54:12,809 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,810 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,810 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:54:12,810 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:54:12,810 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:12,811 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,811 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:12,812 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:54:12,812 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,812 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:12,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:12,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:12,812 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:54:12,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:12,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:12,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:12,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:12,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:54:12,814 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:54:12,814 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:12,814 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:12,814 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,814 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:12,819 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,819 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:12,819 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:12,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:12,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,820 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:12,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:12,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:12,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:12,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,821 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:12,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,823 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,823 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,823 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:12,823 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,823 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:12,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:12,823 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:12,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:12,823 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:12,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:12,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-11 11:54:12,824 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,824 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,824 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:12,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:12,824 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:12,824 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:12,924 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:12,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:12,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:12,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:12,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,930 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:12,930 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:12,930 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:54:12,930 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:54:12,931 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,931 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,932 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:12,932 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:12,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:12,933 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:12,933 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:12,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:12,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,933 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,934 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:54:12,934 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:12,934 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:54:12,934 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:12,934 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:54:12,934 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:12,934 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:12,934 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:12,934 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. started... 2023-11-11 11:54:12,934 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e83876f9f0be04ff0c4dd2585fadf76a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:13,347 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b5894f95a7eb4b7ab7b1d582d75d9ae2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103b5894f95a7eb4b7ab7b1d582d75d9ae2 2023-11-11 11:54:13,752 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/634f94e2f3294fe1b302a43d4f028da1 2023-11-11 11:54:13,757 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/634f94e2f3294fe1b302a43d4f028da1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/634f94e2f3294fe1b302a43d4f028da1 2023-11-11 11:54:13,761 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/634f94e2f3294fe1b302a43d4f028da1, entries=1, sequenceid=33, filesize=4.9 K 2023-11-11 11:54:13,761 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e83876f9f0be04ff0c4dd2585fadf76a in 827ms, sequenceid=33, compaction requested=true 2023-11-11 11:54:13,762 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:13,762 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:13,762 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:13,762 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:13,762 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,762 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:54:13,762 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:54:13,772 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,772 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:13,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:13,773 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,773 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:13,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:13,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:13,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:13,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:54:13,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c4c4a4e[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:13,774 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:54:13,774 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,775 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,775 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:54:13,776 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:54:13,776 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:13,776 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,776 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:13,777 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:54:13,777 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:13,777 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,777 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:54:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:13,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:13,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:13,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:13,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:54:13,779 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:54:13,779 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:13,779 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:13,779 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,779 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:13,781 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,781 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,781 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:13,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:13,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:13,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:13,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:13,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:13,782 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:13,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,784 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:13,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,786 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:13,786 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,786 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:13,786 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:13,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:13,786 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:13,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:13,787 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:13,787 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,787 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:13,787 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,787 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:13,787 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:13,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:13,787 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,887 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:13,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:13,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:13,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:13,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,893 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:13,893 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:13,893 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:54:13,893 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:54:13,894 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,894 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,895 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,895 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:13,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:13,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:13,895 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:13,895 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:13,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,896 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:13,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,896 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,896 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:54:13,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:13,896 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:54:13,896 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:13,896 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:54:13,896 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:13,897 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:13,897 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:13,897 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. started... 2023-11-11 11:54:13,897 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e83876f9f0be04ff0c4dd2585fadf76a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:14,309 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907af82c674060e4f47b8891a83be86e2e4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907af82c674060e4f47b8891a83be86e2e4 2023-11-11 11:54:14,714 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/a3696aa5f00f4401830c96aa849121f9 2023-11-11 11:54:14,719 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/a3696aa5f00f4401830c96aa849121f9 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/a3696aa5f00f4401830c96aa849121f9 2023-11-11 11:54:14,723 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/a3696aa5f00f4401830c96aa849121f9, entries=1, sequenceid=37, filesize=4.9 K 2023-11-11 11:54:14,724 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e83876f9f0be04ff0c4dd2585fadf76a in 827ms, sequenceid=37, compaction requested=true 2023-11-11 11:54:14,724 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:14,724 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:14,724 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:14,724 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:14,724 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,724 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:54:14,724 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:54:14,726 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,726 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:14,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:14,727 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,727 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:14,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:14,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:14,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:14,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:54:14,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d7ababd[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:14,728 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:54:14,728 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,731 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,731 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:54:14,731 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:54:14,731 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:14,731 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,731 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:14,732 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,732 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:54:14,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:14,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:14,732 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:14,733 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:54:14,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:14,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:14,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:14,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:14,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:54:14,735 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:54:14,735 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:14,735 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:14,735 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,735 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:14,736 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,736 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:14,736 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:14,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:14,737 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:14,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,738 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:14,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,740 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,740 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,741 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,741 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,741 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,741 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,741 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,741 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:14,741 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:14,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:14,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:14,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-11 11:54:14,741 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:14,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:14,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:14,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:14,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:14,741 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:14,741 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:14,841 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:14,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:14,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:14,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:14,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,848 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:14,848 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:14,848 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-11 11:54:14,848 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-11 11:54:14,848 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,848 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,850 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:14,850 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:14,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:14,851 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:14,851 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:14,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:14,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,852 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,852 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-11 11:54:14,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:14,852 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-11 11:54:14,852 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:14,852 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-11 11:54:14,852 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:14,852 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:14,852 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:14,852 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. started... 2023-11-11 11:54:14,852 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e83876f9f0be04ff0c4dd2585fadf76a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:15,264 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a7f5aa1ea0b940e0812cc39cff90d2ec to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120a7f5aa1ea0b940e0812cc39cff90d2ec 2023-11-11 11:54:15,269 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/0ff8c0dbe5204f09bdcbc2dd9beb8ab2 2023-11-11 11:54:15,274 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/0ff8c0dbe5204f09bdcbc2dd9beb8ab2 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/0ff8c0dbe5204f09bdcbc2dd9beb8ab2 2023-11-11 11:54:15,278 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/0ff8c0dbe5204f09bdcbc2dd9beb8ab2, entries=1, sequenceid=41, filesize=4.9 K 2023-11-11 11:54:15,278 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e83876f9f0be04ff0c4dd2585fadf76a in 426ms, sequenceid=41, compaction requested=true 2023-11-11 11:54:15,278 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:15,279 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:15,279 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:15,279 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:15,279 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,279 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-11 11:54:15,279 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-11 11:54:15,280 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,280 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:15,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:15,281 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,281 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:15,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:15,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:15,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:15,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-11 11:54:15,282 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-11 11:54:15,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10f94e68[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:15,282 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,283 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,284 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-11 11:54:15,284 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-11 11:54:15,284 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:15,284 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,284 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:15,285 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,285 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-11 11:54:15,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:15,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:15,285 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:15,285 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-11 11:54:15,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:15,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:15,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:15,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:15,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:54:15,287 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-11 11:54:15,288 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:15,288 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:15,288 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,288 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:15,290 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,290 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:15,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:15,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,290 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:15,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:15,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:15,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:15,291 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,292 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:15,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,297 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,297 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:15,297 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:15,297 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,297 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:15,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:15,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-11 11:54:15,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:15,297 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,297 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:15,297 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,297 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,297 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:15,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:15,298 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:15,298 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:15,398 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:15,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:15,400 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-11 11:54:15,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 11:54:15,402 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 11:54:15,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:15,403 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704255403 2023-11-11 11:54:15,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 11:54:15,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-11 11:54:15,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 11:54:15,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x466cea95 to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:54:15,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79e3af22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:54:15,411 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:54:15,850 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033d00c280daaf44f4a4a17f9000ebedf4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601033d00c280daaf44f4a4a17f9000ebedf4 2023-11-11 11:54:15,851 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 11:54:15,863 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:54:15,864 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:54:15,871 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:54:15,872 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:54:15,880 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a604307b6d9b42eba5a1b95e55c8616c first=Optional[r3] last=Optional[r6] 2023-11-11 11:54:15,881 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a604307b6d9b42eba5a1b95e55c8616c}] 2023-11-11 11:54:15,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a604307b6d9b42eba5a1b95e55c8616c for inclusion in e83876f9f0be04ff0c4dd2585fadf76a/family1 2023-11-11 11:54:15,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-11 11:54:15,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:54:15,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:15,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a604307b6d9b42eba5a1b95e55c8616c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5a2l64itmrdb9hcng3aid8itmi8svvqh6cl7ecthioubutc1tbtqvmjsun1o32tk/family1/a604307b6d9b42eba5a1b95e55c8616c 2023-11-11 11:54:15,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5a2l64itmrdb9hcng3aid8itmi8svvqh6cl7ecthioubutc1tbtqvmjsun1o32tk/family1/a604307b6d9b42eba5a1b95e55c8616c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/c14fccfca63b4ffe8828e168528a9797_SeqId_44_ 2023-11-11 11:54:15,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5a2l64itmrdb9hcng3aid8itmi8svvqh6cl7ecthioubutc1tbtqvmjsun1o32tk/family1/a604307b6d9b42eba5a1b95e55c8616c into e83876f9f0be04ff0c4dd2585fadf76a/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/c14fccfca63b4ffe8828e168528a9797_SeqId_44_ - updating store file list. 2023-11-11 11:54:15,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/c14fccfca63b4ffe8828e168528a9797_SeqId_44_ into e83876f9f0be04ff0c4dd2585fadf76a/family1 2023-11-11 11:54:15,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5a2l64itmrdb9hcng3aid8itmi8svvqh6cl7ecthioubutc1tbtqvmjsun1o32tk/family1/a604307b6d9b42eba5a1b95e55c8616c into e83876f9f0be04ff0c4dd2585fadf76a/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/c14fccfca63b4ffe8828e168528a9797_SeqId_44_) 2023-11-11 11:54:15,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5a2l64itmrdb9hcng3aid8itmi8svvqh6cl7ecthioubutc1tbtqvmjsun1o32tk/family1/a604307b6d9b42eba5a1b95e55c8616c 2023-11-11 11:54:15,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 11:54:15,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 11:54:15,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(1912): e83876f9f0be04ff0c4dd2585fadf76a/family1 is initiating minor compaction 2023-11-11 11:54:15,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@22a65fc1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:15,896 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e83876f9f0be04ff0c4dd2585fadf76a/family1 in testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:54:15,897 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/410d43d95e1b42289515e4f79f7c86a8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/44f52113ad95447d98ba41e873f8b141, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/79828d9940a94cd38c90da1587c52bc9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/f3b2b0c19c6f4e8287e91da9af3bc5a4, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/a295e4db34ac41d1b56b2b255a509413, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/8f36472bed0045d78f84d73923d4d794, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/634f94e2f3294fe1b302a43d4f028da1, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/a3696aa5f00f4401830c96aa849121f9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/0ff8c0dbe5204f09bdcbc2dd9beb8ab2, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/c14fccfca63b4ffe8828e168528a9797_SeqId_44_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp, totalSize=50.0 K 2023-11-11 11:54:15,897 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 410d43d95e1b42289515e4f79f7c86a8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 11:54:15,897 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 44f52113ad95447d98ba41e873f8b141, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 11:54:15,897 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 79828d9940a94cd38c90da1587c52bc9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 11:54:15,897 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting f3b2b0c19c6f4e8287e91da9af3bc5a4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 11:54:15,897 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting a295e4db34ac41d1b56b2b255a509413, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 11:54:15,897 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 8f36472bed0045d78f84d73923d4d794, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 11:54:15,897 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 634f94e2f3294fe1b302a43d4f028da1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 11:54:15,897 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting a3696aa5f00f4401830c96aa849121f9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 11:54:15,897 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 0ff8c0dbe5204f09bdcbc2dd9beb8ab2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 11:54:15,897 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting c14fccfca63b4ffe8828e168528a9797_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 11:54:15,898 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 11:54:15,899 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:15,901 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228193d00f0fb5a4626ac64a8165c201da1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228193d00f0fb5a4626ac64a8165c201da1 2023-11-11 11:54:15,902 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231ce3f682c4d5a4c85946ded83ffad73bb to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231ce3f682c4d5a4c85946ded83ffad73bb 2023-11-11 11:54:15,903 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101400554d6e5484114b6e1f6617222a9c4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101400554d6e5484114b6e1f6617222a9c4 2023-11-11 11:54:15,905 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103b5894f95a7eb4b7ab7b1d582d75d9ae2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103b5894f95a7eb4b7ab7b1d582d75d9ae2 2023-11-11 11:54:15,905 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-11 11:54:15,905 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-11 11:54:15,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:54:15,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:54:15,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:54:15,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:54:15,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:54:15,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:54:15,906 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:54:15,906 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:54:15,932 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): e83876f9f0be04ff0c4dd2585fadf76a#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:54:16,361 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056a33f087d4df4e32ade3c349a8d6d150 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056a33f087d4df4e32ade3c349a8d6d150 2023-11-11 11:54:16,362 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 11:54:16,393 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b78c5c3e870d408c9f22d523e63b9323 first=Optional[r00] last=Optional[r2] 2023-11-11 11:54:16,393 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b78c5c3e870d408c9f22d523e63b9323}] 2023-11-11 11:54:16,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b78c5c3e870d408c9f22d523e63b9323 for inclusion in e83876f9f0be04ff0c4dd2585fadf76a/family1 2023-11-11 11:54:16,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-11 11:54:16,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:54:16,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:16,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b78c5c3e870d408c9f22d523e63b9323 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9j8ruv5ff5jodthgi2vhsn2or1q067cmc9l8cdm5bsumr4gq3tag9vfv4jvs59gr/family1/b78c5c3e870d408c9f22d523e63b9323 2023-11-11 11:54:16,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9j8ruv5ff5jodthgi2vhsn2or1q067cmc9l8cdm5bsumr4gq3tag9vfv4jvs59gr/family1/b78c5c3e870d408c9f22d523e63b9323 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/c3b22c9ec70142acb14d8ccf0996ca32_SeqId_46_ 2023-11-11 11:54:16,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9j8ruv5ff5jodthgi2vhsn2or1q067cmc9l8cdm5bsumr4gq3tag9vfv4jvs59gr/family1/b78c5c3e870d408c9f22d523e63b9323 into e83876f9f0be04ff0c4dd2585fadf76a/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/c3b22c9ec70142acb14d8ccf0996ca32_SeqId_46_ - updating store file list. 2023-11-11 11:54:16,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/c3b22c9ec70142acb14d8ccf0996ca32_SeqId_46_ into e83876f9f0be04ff0c4dd2585fadf76a/family1 2023-11-11 11:54:16,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9j8ruv5ff5jodthgi2vhsn2or1q067cmc9l8cdm5bsumr4gq3tag9vfv4jvs59gr/family1/b78c5c3e870d408c9f22d523e63b9323 into e83876f9f0be04ff0c4dd2585fadf76a/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/c3b22c9ec70142acb14d8ccf0996ca32_SeqId_46_) 2023-11-11 11:54:16,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9j8ruv5ff5jodthgi2vhsn2or1q067cmc9l8cdm5bsumr4gq3tag9vfv4jvs59gr/family1/b78c5c3e870d408c9f22d523e63b9323 2023-11-11 11:54:16,406 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 11:54:16,407 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:16,408 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130041dddfc434149bdbefd0d1b0b987188 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130041dddfc434149bdbefd0d1b0b987188 2023-11-11 11:54:16,409 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201be7afb8c80774349837b7d8a54cf85d4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201be7afb8c80774349837b7d8a54cf85d4 2023-11-11 11:54:16,410 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056e246c0308314d1692fd537a15826ab7 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512056e246c0308314d1692fd537a15826ab7 2023-11-11 11:54:16,410 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-11 11:54:16,410 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-11 11:54:16,411 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-11 11:54:16,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-11 11:54:16,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:16,412 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 11:54:16,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.0120 sec 2023-11-11 11:54:16,516 INFO [Listener at localhost/39241] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=258 (was 262), OpenFileDescriptor=644 (was 645), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=208 (was 245), ProcessCount=170 (was 170), AvailableMemoryMB=2149 (was 2189) 2023-11-11 11:54:16,527 INFO [Listener at localhost/39241] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=258, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=208, ProcessCount=170, AvailableMemoryMB=2149 2023-11-11 11:54:16,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-11 11:54:16,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:16,531 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 11:54:16,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-11 11:54:16,532 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 11:54:16,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-11 11:54:16,533 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:16,533 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17 empty. 2023-11-11 11:54:16,534 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:16,534 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-11 11:54:16,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-11 11:54:16,748 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/.tmp/family1/70c59083daf64503bc35cdfda5d3bd89 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/70c59083daf64503bc35cdfda5d3bd89 2023-11-11 11:54:16,752 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e83876f9f0be04ff0c4dd2585fadf76a/family1 of e83876f9f0be04ff0c4dd2585fadf76a into 70c59083daf64503bc35cdfda5d3bd89(size=6.6 K), total size for store is 337.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:54:16,752 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:54:16,752 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699703655896; duration=0sec 2023-11-11 11:54:16,752 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:16,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-11 11:54:16,843 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/410d43d95e1b42289515e4f79f7c86a8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/44f52113ad95447d98ba41e873f8b141, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/79828d9940a94cd38c90da1587c52bc9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/f3b2b0c19c6f4e8287e91da9af3bc5a4, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/a295e4db34ac41d1b56b2b255a509413, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/8f36472bed0045d78f84d73923d4d794, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/634f94e2f3294fe1b302a43d4f028da1, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/a3696aa5f00f4401830c96aa849121f9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/0ff8c0dbe5204f09bdcbc2dd9beb8ab2, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/c14fccfca63b4ffe8828e168528a9797_SeqId_44_] to archive 2023-11-11 11:54:16,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:16,846 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/410d43d95e1b42289515e4f79f7c86a8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/410d43d95e1b42289515e4f79f7c86a8 2023-11-11 11:54:16,848 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/44f52113ad95447d98ba41e873f8b141 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/44f52113ad95447d98ba41e873f8b141 2023-11-11 11:54:16,849 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/79828d9940a94cd38c90da1587c52bc9 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/79828d9940a94cd38c90da1587c52bc9 2023-11-11 11:54:16,851 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/f3b2b0c19c6f4e8287e91da9af3bc5a4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/f3b2b0c19c6f4e8287e91da9af3bc5a4 2023-11-11 11:54:16,852 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/a295e4db34ac41d1b56b2b255a509413 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/a295e4db34ac41d1b56b2b255a509413 2023-11-11 11:54:16,853 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/8f36472bed0045d78f84d73923d4d794 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/8f36472bed0045d78f84d73923d4d794 2023-11-11 11:54:16,854 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/634f94e2f3294fe1b302a43d4f028da1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/634f94e2f3294fe1b302a43d4f028da1 2023-11-11 11:54:16,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/a3696aa5f00f4401830c96aa849121f9 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/a3696aa5f00f4401830c96aa849121f9 2023-11-11 11:54:16,857 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/0ff8c0dbe5204f09bdcbc2dd9beb8ab2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/0ff8c0dbe5204f09bdcbc2dd9beb8ab2 2023-11-11 11:54:16,858 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/c14fccfca63b4ffe8828e168528a9797_SeqId_44_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/family1/c14fccfca63b4ffe8828e168528a9797_SeqId_44_ 2023-11-11 11:54:16,942 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-11 11:54:16,943 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0cb4b137d2c1690927cb67dbaea29e17, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:54:16,948 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:16,948 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 0cb4b137d2c1690927cb67dbaea29e17, disabling compactions & flushes 2023-11-11 11:54:16,948 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:16,948 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:16,948 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. after waiting 0 ms 2023-11-11 11:54:16,948 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:16,948 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:16,948 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:16,950 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 11:54:16,951 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699703656951"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703656951"}]},"ts":"1699703656951"} 2023-11-11 11:54:16,952 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 11:54:16,954 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 11:54:16,954 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703656954"}]},"ts":"1699703656954"} 2023-11-11 11:54:16,955 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-11 11:54:16,961 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0cb4b137d2c1690927cb67dbaea29e17, ASSIGN}] 2023-11-11 11:54:16,963 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0cb4b137d2c1690927cb67dbaea29e17, ASSIGN 2023-11-11 11:54:16,963 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0cb4b137d2c1690927cb67dbaea29e17, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:54:17,114 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0cb4b137d2c1690927cb67dbaea29e17, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:17,114 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699703657114"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703657114"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703657114"}]},"ts":"1699703657114"} 2023-11-11 11:54:17,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 0cb4b137d2c1690927cb67dbaea29e17, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:17,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-11 11:54:17,268 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:17,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:17,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0cb4b137d2c1690927cb67dbaea29e17, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:54:17,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:17,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:17,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:17,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:17,272 INFO [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:17,273 DEBUG [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1 2023-11-11 11:54:17,273 DEBUG [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1 2023-11-11 11:54:17,274 INFO [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0cb4b137d2c1690927cb67dbaea29e17 columnFamilyName family1 2023-11-11 11:54:17,275 INFO [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] regionserver.HStore(310): Store=0cb4b137d2c1690927cb67dbaea29e17/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:17,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:17,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:17,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:17,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:54:17,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0cb4b137d2c1690927cb67dbaea29e17; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66803988, jitterRate=-0.004543006420135498}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:54:17,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:17,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17., pid=41, masterSystemTime=1699703657267 2023-11-11 11:54:17,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:17,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:17,283 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0cb4b137d2c1690927cb67dbaea29e17, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:17,283 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699703657283"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703657283"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703657283"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703657283"}]},"ts":"1699703657283"} 2023-11-11 11:54:17,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-11 11:54:17,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 0cb4b137d2c1690927cb67dbaea29e17, server=jenkins-hbase4.apache.org,41363,1699703601801 in 168 msec 2023-11-11 11:54:17,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-11 11:54:17,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0cb4b137d2c1690927cb67dbaea29e17, ASSIGN in 325 msec 2023-11-11 11:54:17,288 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 11:54:17,288 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703657288"}]},"ts":"1699703657288"} 2023-11-11 11:54:17,289 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-11 11:54:17,291 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 11:54:17,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 762 msec 2023-11-11 11:54:17,305 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:17,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-11 11:54:17,638 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-11 11:54:17,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:17,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:17,659 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:17,659 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:17,659 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 11:54:17,659 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 11:54:17,660 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:17,660 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:17,661 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:17,661 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:17,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:17,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:17,662 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:17,662 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:17,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:17,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:17,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:17,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:17,662 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:17,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:17,663 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 11:54:17,663 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:17,663 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 11:54:17,663 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:17,663 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:17,663 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:17,663 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. started... 2023-11-11 11:54:17,664 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0cb4b137d2c1690927cb67dbaea29e17 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 11:54:18,080 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c7d30a72559e4366a5ffc8ca6db52dc6 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130c7d30a72559e4366a5ffc8ca6db52dc6 2023-11-11 11:54:18,484 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/12c9bc601bd8449eb7435b7b0431dd5c 2023-11-11 11:54:18,488 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/12c9bc601bd8449eb7435b7b0431dd5c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/12c9bc601bd8449eb7435b7b0431dd5c 2023-11-11 11:54:18,493 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/12c9bc601bd8449eb7435b7b0431dd5c, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-11 11:54:18,494 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0cb4b137d2c1690927cb67dbaea29e17 in 830ms, sequenceid=5, compaction requested=false 2023-11-11 11:54:18,495 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:18,495 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:18,495 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:18,495 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:18,495 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,495 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 11:54:18,495 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 11:54:18,497 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,497 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:18,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:18,497 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,497 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:18,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:18,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:18,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:18,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 11:54:18,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a0a305c[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:18,498 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 11:54:18,498 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,501 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,501 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 11:54:18,501 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 11:54:18,501 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:18,501 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,501 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:18,502 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 11:54:18,502 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:18,502 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,502 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 11:54:18,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:18,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:18,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:18,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:18,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:18,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:18,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 11:54:18,505 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 11:54:18,505 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:18,505 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:18,505 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,505 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:18,506 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,506 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:18,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:18,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,507 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:18,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:18,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:18,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:18,507 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,508 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:18,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,510 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,510 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,510 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:18,510 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,510 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:18,510 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:18,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:18,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:18,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:18,510 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:18,511 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,511 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,511 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,511 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:18,511 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:18,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:18,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:18,611 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:18,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:18,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:18,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:18,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,617 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:18,617 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:18,617 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 11:54:18,617 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 11:54:18,618 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,618 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,620 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,620 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:18,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:18,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:18,620 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:18,620 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:18,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:18,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,621 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,621 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 11:54:18,621 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:18,621 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 11:54:18,621 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:18,621 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 11:54:18,621 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:18,621 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:18,621 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:18,621 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. started... 2023-11-11 11:54:18,621 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0cb4b137d2c1690927cb67dbaea29e17 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 11:54:19,034 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283f59b6f6e5004503bc32233bec70330f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511283f59b6f6e5004503bc32233bec70330f 2023-11-11 11:54:19,440 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/42dd3d547b6a43d7b4ee3a76527cc9cd 2023-11-11 11:54:19,445 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/42dd3d547b6a43d7b4ee3a76527cc9cd as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/42dd3d547b6a43d7b4ee3a76527cc9cd 2023-11-11 11:54:19,449 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/42dd3d547b6a43d7b4ee3a76527cc9cd, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 11:54:19,449 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0cb4b137d2c1690927cb67dbaea29e17 in 828ms, sequenceid=9, compaction requested=false 2023-11-11 11:54:19,450 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:19,450 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:19,450 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:19,450 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:19,450 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,450 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 11:54:19,450 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 11:54:19,452 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,452 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:19,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:19,452 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,452 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:19,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:19,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:19,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:19,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 11:54:19,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74ba1f69[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:19,454 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 11:54:19,454 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,455 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,455 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 11:54:19,455 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 11:54:19,455 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:19,455 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,455 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:19,457 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,457 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 11:54:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:19,457 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:19,457 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 11:54:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:19,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:19,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:19,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:19,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 11:54:19,459 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 11:54:19,459 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:19,459 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:19,459 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,459 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:19,462 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,462 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:19,462 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:19,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:19,463 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,464 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:19,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,469 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,469 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,469 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:19,469 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,469 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:19,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:19,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:19,469 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:19,469 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:19,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:19,469 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,469 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,470 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:19,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:19,470 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:19,470 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:19,570 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:19,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:19,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:19,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:19,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,576 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:19,576 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:19,576 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 11:54:19,576 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 11:54:19,577 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,577 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,578 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,578 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:19,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:19,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:19,578 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:19,578 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:19,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:19,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,579 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,579 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 11:54:19,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:19,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 11:54:19,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:19,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 11:54:19,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:19,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:19,580 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:19,580 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. started... 2023-11-11 11:54:19,580 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0cb4b137d2c1690927cb67dbaea29e17 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:19,992 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ea7081d0906c4289a4d4f2fb7482a802 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ea7081d0906c4289a4d4f2fb7482a802 2023-11-11 11:54:20,398 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/bb74b67a873a4accbc91649f9438bc59 2023-11-11 11:54:20,403 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/bb74b67a873a4accbc91649f9438bc59 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/bb74b67a873a4accbc91649f9438bc59 2023-11-11 11:54:20,407 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/bb74b67a873a4accbc91649f9438bc59, entries=1, sequenceid=13, filesize=5.0 K 2023-11-11 11:54:20,408 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cb4b137d2c1690927cb67dbaea29e17 in 828ms, sequenceid=13, compaction requested=true 2023-11-11 11:54:20,408 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:20,408 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:20,408 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:20,408 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:20,408 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,408 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 11:54:20,408 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 11:54:20,410 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,410 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:20,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:20,410 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,410 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:20,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:20,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:20,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:20,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 11:54:20,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cddfc11[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:20,412 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 11:54:20,412 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,414 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,414 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 11:54:20,415 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 11:54:20,415 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:20,415 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,415 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:20,416 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,416 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 11:54:20,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:20,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:20,416 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:20,416 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 11:54:20,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:20,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:20,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 11:54:20,418 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 11:54:20,418 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:20,418 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:20,418 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,418 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:20,420 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,420 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,420 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:20,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:20,421 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,422 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:20,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:20,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:20,424 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:20,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-11 11:54:20,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:20,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:20,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:20,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,424 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,425 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,425 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:20,425 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:20,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:20,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:20,525 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:20,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:20,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:20,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:20,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,531 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:20,531 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:20,531 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 11:54:20,531 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 11:54:20,531 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,531 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,533 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:20,533 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:20,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:20,534 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:20,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,534 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:20,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:20,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,534 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,535 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 11:54:20,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:20,535 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 11:54:20,535 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:20,535 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 11:54:20,535 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:20,535 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:20,535 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:20,535 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. started... 2023-11-11 11:54:20,535 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0cb4b137d2c1690927cb67dbaea29e17 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:20,947 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205178163de36a24ecc8403f2d043ba1176 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205178163de36a24ecc8403f2d043ba1176 2023-11-11 11:54:21,352 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/ebfe1bbb024545478a08dd87129b351b 2023-11-11 11:54:21,356 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/ebfe1bbb024545478a08dd87129b351b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/ebfe1bbb024545478a08dd87129b351b 2023-11-11 11:54:21,360 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/ebfe1bbb024545478a08dd87129b351b, entries=1, sequenceid=17, filesize=5.0 K 2023-11-11 11:54:21,361 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cb4b137d2c1690927cb67dbaea29e17 in 826ms, sequenceid=17, compaction requested=true 2023-11-11 11:54:21,361 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:21,361 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:21,361 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:21,361 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:21,361 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,361 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 11:54:21,361 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 11:54:21,363 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,363 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:21,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:21,363 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,363 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:21,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:21,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:21,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:21,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 11:54:21,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@660d7fec[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:21,364 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 11:54:21,364 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,366 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,366 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 11:54:21,366 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 11:54:21,366 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:21,366 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,366 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:21,367 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 11:54:21,367 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:21,367 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,367 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 11:54:21,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:21,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:21,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:21,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:21,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:21,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:21,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 11:54:21,370 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 11:54:21,370 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:21,370 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:21,370 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,370 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:21,373 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,373 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:21,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:21,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,373 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:21,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:21,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:21,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:21,373 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:21,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,375 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:21,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,377 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,377 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:21,377 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:21,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:21,377 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:21,377 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:21,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-11 11:54:21,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:21,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:21,377 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:21,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:21,377 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,377 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,377 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,377 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:21,378 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:21,377 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,478 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:21,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:21,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:21,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:21,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,483 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:21,484 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:21,484 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 11:54:21,484 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 11:54:21,484 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,484 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,485 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,485 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:21,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:21,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:21,486 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:21,486 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,487 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,487 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 11:54:21,487 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:21,487 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 11:54:21,487 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:21,487 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 11:54:21,487 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:21,487 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:21,487 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:21,487 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. started... 2023-11-11 11:54:21,487 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0cb4b137d2c1690927cb67dbaea29e17 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:21,899 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228fc3fbfa44499445881ca070d94463365 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228fc3fbfa44499445881ca070d94463365 2023-11-11 11:54:22,304 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/c56fafafa99b411b9be33c801bbbbad4 2023-11-11 11:54:22,309 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/c56fafafa99b411b9be33c801bbbbad4 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/c56fafafa99b411b9be33c801bbbbad4 2023-11-11 11:54:22,313 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/c56fafafa99b411b9be33c801bbbbad4, entries=1, sequenceid=21, filesize=5.0 K 2023-11-11 11:54:22,313 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cb4b137d2c1690927cb67dbaea29e17 in 826ms, sequenceid=21, compaction requested=true 2023-11-11 11:54:22,313 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:22,313 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:22,314 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:22,314 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:22,314 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,314 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 11:54:22,314 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 11:54:22,319 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,319 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:22,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:22,319 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,319 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:22,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:22,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:22,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:22,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 11:54:22,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d8e2ba1[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:22,321 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 11:54:22,321 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,322 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,322 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 11:54:22,322 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 11:54:22,322 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:22,322 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,322 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:22,323 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 11:54:22,323 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:22,323 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,323 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 11:54:22,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:22,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:22,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:22,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:22,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:22,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:22,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 11:54:22,326 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 11:54:22,326 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:22,326 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:22,326 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,326 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:22,329 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,329 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,329 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:22,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:22,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:22,329 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:22,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,330 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:22,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,333 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,333 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,333 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,333 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:22,333 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,333 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:22,333 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:22,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:22,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:22,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:22,333 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:22,333 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,333 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,333 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:22,334 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:22,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:22,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:22,434 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:22,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:22,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:22,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:22,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,440 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:22,440 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:22,440 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 11:54:22,440 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 11:54:22,441 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,441 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,442 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:22,442 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:22,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:22,443 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:22,443 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:22,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:22,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,443 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,444 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 11:54:22,444 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:22,444 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 11:54:22,444 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:22,444 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 11:54:22,444 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:22,444 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:22,444 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:22,444 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. started... 2023-11-11 11:54:22,444 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0cb4b137d2c1690927cb67dbaea29e17 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:22,799 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 11:54:22,856 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123152053fcb1c8d468f889e459519d2e95c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123152053fcb1c8d468f889e459519d2e95c 2023-11-11 11:54:23,157 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-11 11:54:23,262 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/097a95b6202749ac8afec201760b5745 2023-11-11 11:54:23,268 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/097a95b6202749ac8afec201760b5745 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/097a95b6202749ac8afec201760b5745 2023-11-11 11:54:23,272 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/097a95b6202749ac8afec201760b5745, entries=1, sequenceid=25, filesize=5.0 K 2023-11-11 11:54:23,272 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cb4b137d2c1690927cb67dbaea29e17 in 828ms, sequenceid=25, compaction requested=true 2023-11-11 11:54:23,272 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:23,272 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:23,273 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:23,273 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:23,273 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,273 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 11:54:23,273 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 11:54:23,276 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,276 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:23,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:23,276 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,276 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:23,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:23,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:23,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:23,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 11:54:23,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49eb302e[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:23,277 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 11:54:23,277 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,278 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,279 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 11:54:23,279 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 11:54:23,279 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:23,279 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,279 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:23,280 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,280 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 11:54:23,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:23,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:23,280 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:23,280 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 11:54:23,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:23,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:23,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:23,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 11:54:23,282 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 11:54:23,282 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:23,282 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:23,282 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,282 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:23,284 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,284 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:23,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,284 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:23,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:23,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:23,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:23,285 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:23,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,286 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:23,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,289 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,289 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,289 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,289 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:23,289 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,289 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:23,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:23,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:23,289 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:23,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:23,289 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:23,289 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,289 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:23,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-11 11:54:23,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:23,289 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:23,290 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:23,390 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:23,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:23,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:23,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:23,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,396 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:23,396 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:23,396 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 11:54:23,396 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 11:54:23,396 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,396 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,398 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:23,398 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:23,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:23,398 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:23,398 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:23,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:23,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,399 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,399 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 11:54:23,399 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:23,399 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 11:54:23,399 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:23,399 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 11:54:23,399 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:23,399 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:23,399 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:23,399 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. started... 2023-11-11 11:54:23,399 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0cb4b137d2c1690927cb67dbaea29e17 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:23,813 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101dd1c8e12ce1546bab3ebc5101166bdd5 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101dd1c8e12ce1546bab3ebc5101166bdd5 2023-11-11 11:54:24,218 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/13faef63693b4948ab2352f45db40a1a 2023-11-11 11:54:24,223 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/13faef63693b4948ab2352f45db40a1a as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/13faef63693b4948ab2352f45db40a1a 2023-11-11 11:54:24,228 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/13faef63693b4948ab2352f45db40a1a, entries=1, sequenceid=29, filesize=5.0 K 2023-11-11 11:54:24,229 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cb4b137d2c1690927cb67dbaea29e17 in 830ms, sequenceid=29, compaction requested=true 2023-11-11 11:54:24,229 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:24,229 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:24,229 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:24,229 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:24,229 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,229 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 11:54:24,229 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 11:54:24,231 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,231 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:24,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:24,231 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,231 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:24,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:24,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:24,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:24,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 11:54:24,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a057076[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:24,233 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 11:54:24,233 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,234 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,234 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 11:54:24,235 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 11:54:24,235 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:24,235 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,235 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:24,243 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 11:54:24,243 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:24,243 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,243 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 11:54:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:24,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 11:54:24,245 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 11:54:24,245 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:24,245 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:24,245 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,245 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:24,247 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,247 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:24,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:24,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,247 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:24,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:24,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:24,247 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:24,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:24,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,248 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:24,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,251 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,251 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:24,251 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,251 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:24,251 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,251 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,251 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:24,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:24,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-11 11:54:24,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:24,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:24,251 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:24,251 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,251 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,251 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:24,251 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:24,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:24,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:24,351 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:24,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:24,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:24,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:24,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,358 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:24,358 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:24,358 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 11:54:24,358 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 11:54:24,358 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,358 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,359 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,360 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:24,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:24,360 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:24,360 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,361 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,361 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 11:54:24,361 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:24,361 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 11:54:24,361 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:24,361 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 11:54:24,361 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:24,361 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:24,361 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:24,361 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. started... 2023-11-11 11:54:24,362 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0cb4b137d2c1690927cb67dbaea29e17 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:24,774 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f216dd2356d149d6b15ce7cab368d016 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103f216dd2356d149d6b15ce7cab368d016 2023-11-11 11:54:25,179 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/59e908a9cdd94fbe8b6ee8bfc3a57c0c 2023-11-11 11:54:25,183 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/59e908a9cdd94fbe8b6ee8bfc3a57c0c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/59e908a9cdd94fbe8b6ee8bfc3a57c0c 2023-11-11 11:54:25,187 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/59e908a9cdd94fbe8b6ee8bfc3a57c0c, entries=1, sequenceid=33, filesize=5.0 K 2023-11-11 11:54:25,188 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cb4b137d2c1690927cb67dbaea29e17 in 826ms, sequenceid=33, compaction requested=true 2023-11-11 11:54:25,188 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:25,188 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:25,188 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:25,188 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:25,188 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,188 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 11:54:25,188 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 11:54:25,191 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,191 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:25,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:25,191 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,191 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:25,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:25,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:25,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:25,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 11:54:25,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17fa8ec5[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:25,193 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 11:54:25,193 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,194 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,194 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 11:54:25,194 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 11:54:25,194 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:25,194 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,194 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:25,196 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,196 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 11:54:25,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,196 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:25,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:25,196 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 11:54:25,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:25,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:25,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:25,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:25,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:25,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 11:54:25,198 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 11:54:25,198 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:25,198 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:25,198 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,198 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:25,200 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,200 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,200 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:25,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:25,201 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,202 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,206 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,206 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:25,206 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:25,206 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:25,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:25,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:25,206 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:25,206 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,206 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,206 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:25,206 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:25,206 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,206 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:25,207 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:25,307 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:25,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:25,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:25,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:25,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,313 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:25,313 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:25,313 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 11:54:25,313 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 11:54:25,313 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,313 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,314 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:25,314 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:25,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:25,315 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:25,315 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:25,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:25,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,316 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,316 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 11:54:25,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:25,316 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 11:54:25,316 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:25,316 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 11:54:25,316 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:25,316 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:25,316 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:25,316 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. started... 2023-11-11 11:54:25,316 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0cb4b137d2c1690927cb67dbaea29e17 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:25,728 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907d25725db64464e2f9d2d89d19e26331b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907d25725db64464e2f9d2d89d19e26331b 2023-11-11 11:54:26,134 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/f3a15be69d014406b2d31fcac321b23e 2023-11-11 11:54:26,138 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/f3a15be69d014406b2d31fcac321b23e as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/f3a15be69d014406b2d31fcac321b23e 2023-11-11 11:54:26,142 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/f3a15be69d014406b2d31fcac321b23e, entries=1, sequenceid=37, filesize=5.0 K 2023-11-11 11:54:26,143 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cb4b137d2c1690927cb67dbaea29e17 in 827ms, sequenceid=37, compaction requested=true 2023-11-11 11:54:26,143 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:26,143 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:26,143 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:26,143 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:26,143 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,143 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 11:54:26,143 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 11:54:26,145 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,145 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:26,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:26,146 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,146 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:26,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:26,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:26,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:26,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 11:54:26,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b356cb8[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:26,147 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 11:54:26,147 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,148 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,149 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 11:54:26,149 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 11:54:26,149 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:26,150 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,150 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:26,151 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 11:54:26,151 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,151 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:26,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,151 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 11:54:26,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:26,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:26,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:26,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:26,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:26,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:26,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 11:54:26,154 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 11:54:26,154 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:26,154 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:26,154 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,154 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:26,155 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,155 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:26,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,155 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:26,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:26,156 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:26,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,157 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:26,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,163 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,163 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:26,163 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:26,164 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,164 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:26,164 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:26,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:26,164 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:26,164 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:26,164 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,164 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,164 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:26,164 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:26,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:26,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:26,264 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:26,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:26,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:26,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:26,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,271 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:26,271 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:26,271 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-11 11:54:26,271 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-11 11:54:26,271 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,271 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,273 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:26,273 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:26,273 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:26,273 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:26,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,274 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,274 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-11 11:54:26,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:26,274 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-11 11:54:26,274 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:26,274 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-11 11:54:26,274 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:26,274 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:26,274 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:26,274 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. started... 2023-11-11 11:54:26,275 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0cb4b137d2c1690927cb67dbaea29e17 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:26,687 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207951658d882940cf9d795d35adcf8681 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511207951658d882940cf9d795d35adcf8681 2023-11-11 11:54:27,093 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/2b36a4249f524105a72b246378a9f94c 2023-11-11 11:54:27,097 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/2b36a4249f524105a72b246378a9f94c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/2b36a4249f524105a72b246378a9f94c 2023-11-11 11:54:27,101 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/2b36a4249f524105a72b246378a9f94c, entries=1, sequenceid=41, filesize=5.0 K 2023-11-11 11:54:27,102 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0cb4b137d2c1690927cb67dbaea29e17 in 827ms, sequenceid=41, compaction requested=true 2023-11-11 11:54:27,102 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:27,102 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:27,102 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:27,102 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:27,102 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,102 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-11 11:54:27,102 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-11 11:54:27,103 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,103 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:27,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:27,104 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,104 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:27,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:27,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:27,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:27,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-11 11:54:27,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b4f57b0[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:27,105 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-11 11:54:27,105 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,106 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,107 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-11 11:54:27,107 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-11 11:54:27,107 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:27,107 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,107 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:27,109 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,109 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-11 11:54:27,109 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:27,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:27,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:27,109 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-11 11:54:27,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:27,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:27,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:27,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:27,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-11 11:54:27,111 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-11 11:54:27,111 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:27,111 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:27,111 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,111 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:27,113 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,113 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,113 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:27,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:27,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:27,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:27,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:27,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:27,113 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:27,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,115 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:27,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,117 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,118 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,118 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,118 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:27,118 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:27,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:27,118 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,118 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:27,118 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:27,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:27,118 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:27,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:27,118 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,118 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:27,118 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:27,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:27,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:27,218 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:27,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:27,220 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:27,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 11:54:27,222 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 11:54:27,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:27,223 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704267223 2023-11-11 11:54:27,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 11:54:27,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-11 11:54:27,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 11:54:27,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x209b07e6 to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:54:27,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44653668, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:54:27,230 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:28,067 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a836ce78fe294b2ba15ac220fcbc7f73 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a836ce78fe294b2ba15ac220fcbc7f73 2023-11-11 11:54:28,069 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 11:54:28,081 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:54:28,082 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:54:28,088 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:54:28,090 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:54:28,098 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/110048d48e30460d8696c5fe5565e94f first=Optional[r3] last=Optional[r6] 2023-11-11 11:54:28,099 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/110048d48e30460d8696c5fe5565e94f}] 2023-11-11 11:54:28,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/110048d48e30460d8696c5fe5565e94f for inclusion in 0cb4b137d2c1690927cb67dbaea29e17/family1 2023-11-11 11:54:28,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-11 11:54:28,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:54:28,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:28,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/110048d48e30460d8696c5fe5565e94f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7heekchl6q4mgkt3tf5kj62ap6d1428im4brfku54rp0b4fn6pguvffohtmnnuot/family1/110048d48e30460d8696c5fe5565e94f 2023-11-11 11:54:28,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7heekchl6q4mgkt3tf5kj62ap6d1428im4brfku54rp0b4fn6pguvffohtmnnuot/family1/110048d48e30460d8696c5fe5565e94f as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/3e097a144f89401dbedabafbf42236a2_SeqId_44_ 2023-11-11 11:54:28,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7heekchl6q4mgkt3tf5kj62ap6d1428im4brfku54rp0b4fn6pguvffohtmnnuot/family1/110048d48e30460d8696c5fe5565e94f into 0cb4b137d2c1690927cb67dbaea29e17/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/3e097a144f89401dbedabafbf42236a2_SeqId_44_ - updating store file list. 2023-11-11 11:54:28,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/3e097a144f89401dbedabafbf42236a2_SeqId_44_ into 0cb4b137d2c1690927cb67dbaea29e17/family1 2023-11-11 11:54:28,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7heekchl6q4mgkt3tf5kj62ap6d1428im4brfku54rp0b4fn6pguvffohtmnnuot/family1/110048d48e30460d8696c5fe5565e94f into 0cb4b137d2c1690927cb67dbaea29e17/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/3e097a144f89401dbedabafbf42236a2_SeqId_44_) 2023-11-11 11:54:28,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7heekchl6q4mgkt3tf5kj62ap6d1428im4brfku54rp0b4fn6pguvffohtmnnuot/family1/110048d48e30460d8696c5fe5565e94f 2023-11-11 11:54:28,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 11:54:28,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 11:54:28,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(1912): 0cb4b137d2c1690927cb67dbaea29e17/family1 is initiating minor compaction 2023-11-11 11:54:28,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@9f70f95; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:28,115 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0cb4b137d2c1690927cb67dbaea29e17/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:28,115 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/42dd3d547b6a43d7b4ee3a76527cc9cd, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/bb74b67a873a4accbc91649f9438bc59, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/ebfe1bbb024545478a08dd87129b351b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/c56fafafa99b411b9be33c801bbbbad4, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/097a95b6202749ac8afec201760b5745, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/13faef63693b4948ab2352f45db40a1a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/59e908a9cdd94fbe8b6ee8bfc3a57c0c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/f3a15be69d014406b2d31fcac321b23e, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/2b36a4249f524105a72b246378a9f94c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/3e097a144f89401dbedabafbf42236a2_SeqId_44_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp, totalSize=50.4 K 2023-11-11 11:54:28,115 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 42dd3d547b6a43d7b4ee3a76527cc9cd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 11:54:28,115 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting bb74b67a873a4accbc91649f9438bc59, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 11:54:28,115 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting ebfe1bbb024545478a08dd87129b351b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 11:54:28,116 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting c56fafafa99b411b9be33c801bbbbad4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 11:54:28,116 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 097a95b6202749ac8afec201760b5745, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 11:54:28,116 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 13faef63693b4948ab2352f45db40a1a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 11:54:28,116 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 59e908a9cdd94fbe8b6ee8bfc3a57c0c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 11:54:28,116 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting f3a15be69d014406b2d31fcac321b23e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 11:54:28,116 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 2b36a4249f524105a72b246378a9f94c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 11:54:28,116 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 3e097a144f89401dbedabafbf42236a2_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 11:54:28,117 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 11:54:28,117 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:28,119 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228fc3fbfa44499445881ca070d94463365 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228fc3fbfa44499445881ca070d94463365 2023-11-11 11:54:28,120 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123152053fcb1c8d468f889e459519d2e95c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123152053fcb1c8d468f889e459519d2e95c 2023-11-11 11:54:28,122 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101dd1c8e12ce1546bab3ebc5101166bdd5 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101dd1c8e12ce1546bab3ebc5101166bdd5 2023-11-11 11:54:28,123 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103f216dd2356d149d6b15ce7cab368d016 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103f216dd2356d149d6b15ce7cab368d016 2023-11-11 11:54:28,123 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-11 11:54:28,123 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-11 11:54:28,124 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:28,124 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:28,124 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:28,124 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:28,124 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:28,124 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:28,124 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:28,124 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:28,143 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0cb4b137d2c1690927cb67dbaea29e17#family1#compaction#60 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-11 11:54:28,571 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c8d000d1c2c946318d303d32b4a51ffb to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c8d000d1c2c946318d303d32b4a51ffb 2023-11-11 11:54:28,572 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 11:54:28,595 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4635716fa529464eabd41ba36ffa82da first=Optional[r00] last=Optional[r2] 2023-11-11 11:54:28,595 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4635716fa529464eabd41ba36ffa82da}] 2023-11-11 11:54:28,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4635716fa529464eabd41ba36ffa82da for inclusion in 0cb4b137d2c1690927cb67dbaea29e17/family1 2023-11-11 11:54:28,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-11 11:54:28,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:54:28,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:28,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/4635716fa529464eabd41ba36ffa82da to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k5fu3fjmmb2vjk3b852hikc0o64oimensjih8ivds4am0imfdrfuab82qi5arutt/family1/4635716fa529464eabd41ba36ffa82da 2023-11-11 11:54:28,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k5fu3fjmmb2vjk3b852hikc0o64oimensjih8ivds4am0imfdrfuab82qi5arutt/family1/4635716fa529464eabd41ba36ffa82da as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/34b92db7bb9d43f69b6cd3f915c6716b_SeqId_46_ 2023-11-11 11:54:28,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k5fu3fjmmb2vjk3b852hikc0o64oimensjih8ivds4am0imfdrfuab82qi5arutt/family1/4635716fa529464eabd41ba36ffa82da into 0cb4b137d2c1690927cb67dbaea29e17/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/34b92db7bb9d43f69b6cd3f915c6716b_SeqId_46_ - updating store file list. 2023-11-11 11:54:28,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/34b92db7bb9d43f69b6cd3f915c6716b_SeqId_46_ into 0cb4b137d2c1690927cb67dbaea29e17/family1 2023-11-11 11:54:28,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k5fu3fjmmb2vjk3b852hikc0o64oimensjih8ivds4am0imfdrfuab82qi5arutt/family1/4635716fa529464eabd41ba36ffa82da into 0cb4b137d2c1690927cb67dbaea29e17/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/34b92db7bb9d43f69b6cd3f915c6716b_SeqId_46_) 2023-11-11 11:54:28,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k5fu3fjmmb2vjk3b852hikc0o64oimensjih8ivds4am0imfdrfuab82qi5arutt/family1/4635716fa529464eabd41ba36ffa82da 2023-11-11 11:54:28,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 11:54:28,610 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:28,611 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130c7d30a72559e4366a5ffc8ca6db52dc6 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130c7d30a72559e4366a5ffc8ca6db52dc6 2023-11-11 11:54:28,612 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ea7081d0906c4289a4d4f2fb7482a802 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ea7081d0906c4289a4d4f2fb7482a802 2023-11-11 11:54:28,613 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205178163de36a24ecc8403f2d043ba1176 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205178163de36a24ecc8403f2d043ba1176 2023-11-11 11:54:28,613 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-11 11:54:28,613 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-11 11:54:28,614 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:28,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 11:54:28,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:28,615 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 11:54:28,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.3940 sec 2023-11-11 11:54:28,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-11 11:54:28,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:28,963 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/76f66e4f3fea4f78a089b9b6fc8434e4 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/76f66e4f3fea4f78a089b9b6fc8434e4 2023-11-11 11:54:28,967 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0cb4b137d2c1690927cb67dbaea29e17/family1 of 0cb4b137d2c1690927cb67dbaea29e17 into 76f66e4f3fea4f78a089b9b6fc8434e4(size=6.8 K), total size for store is 390.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:54:28,968 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:28,968 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699703668115; duration=0sec 2023-11-11 11:54:28,968 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:29,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/42dd3d547b6a43d7b4ee3a76527cc9cd, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/bb74b67a873a4accbc91649f9438bc59, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/ebfe1bbb024545478a08dd87129b351b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/c56fafafa99b411b9be33c801bbbbad4, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/097a95b6202749ac8afec201760b5745, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/13faef63693b4948ab2352f45db40a1a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/59e908a9cdd94fbe8b6ee8bfc3a57c0c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/f3a15be69d014406b2d31fcac321b23e, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/2b36a4249f524105a72b246378a9f94c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/3e097a144f89401dbedabafbf42236a2_SeqId_44_] to archive 2023-11-11 11:54:29,045 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:29,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/42dd3d547b6a43d7b4ee3a76527cc9cd to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/42dd3d547b6a43d7b4ee3a76527cc9cd 2023-11-11 11:54:29,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/bb74b67a873a4accbc91649f9438bc59 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/bb74b67a873a4accbc91649f9438bc59 2023-11-11 11:54:29,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/ebfe1bbb024545478a08dd87129b351b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/ebfe1bbb024545478a08dd87129b351b 2023-11-11 11:54:29,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/c56fafafa99b411b9be33c801bbbbad4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/c56fafafa99b411b9be33c801bbbbad4 2023-11-11 11:54:29,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/097a95b6202749ac8afec201760b5745 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/097a95b6202749ac8afec201760b5745 2023-11-11 11:54:29,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/13faef63693b4948ab2352f45db40a1a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/13faef63693b4948ab2352f45db40a1a 2023-11-11 11:54:29,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/59e908a9cdd94fbe8b6ee8bfc3a57c0c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/59e908a9cdd94fbe8b6ee8bfc3a57c0c 2023-11-11 11:54:29,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/f3a15be69d014406b2d31fcac321b23e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/f3a15be69d014406b2d31fcac321b23e 2023-11-11 11:54:29,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/2b36a4249f524105a72b246378a9f94c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/2b36a4249f524105a72b246378a9f94c 2023-11-11 11:54:29,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/3e097a144f89401dbedabafbf42236a2_SeqId_44_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/3e097a144f89401dbedabafbf42236a2_SeqId_44_ 2023-11-11 11:54:29,107 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-11 11:54:29,108 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-11 11:54:29,108 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-11 11:54:29,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-11 11:54:29,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0cb4b137d2c1690927cb67dbaea29e17, REOPEN/MOVE}] 2023-11-11 11:54:29,113 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0cb4b137d2c1690927cb67dbaea29e17, REOPEN/MOVE 2023-11-11 11:54:29,113 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=0cb4b137d2c1690927cb67dbaea29e17, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:29,114 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699703669113"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703669113"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703669113"}]},"ts":"1699703669113"} 2023-11-11 11:54:29,115 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 0cb4b137d2c1690927cb67dbaea29e17, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:29,266 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:29,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:29,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0cb4b137d2c1690927cb67dbaea29e17, disabling compactions & flushes 2023-11-11 11:54:29,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:29,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:29,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. after waiting 0 ms 2023-11-11 11:54:29,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:29,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-11 11:54:29,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:29,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:29,273 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 0cb4b137d2c1690927cb67dbaea29e17 to self. 2023-11-11 11:54:29,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:29,274 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=0cb4b137d2c1690927cb67dbaea29e17, regionState=CLOSED 2023-11-11 11:54:29,275 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699703669274"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703669274"}]},"ts":"1699703669274"} 2023-11-11 11:54:29,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-11 11:54:29,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 0cb4b137d2c1690927cb67dbaea29e17, server=jenkins-hbase4.apache.org,41363,1699703601801 in 161 msec 2023-11-11 11:54:29,278 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0cb4b137d2c1690927cb67dbaea29e17, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=true 2023-11-11 11:54:29,428 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=0cb4b137d2c1690927cb67dbaea29e17, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:29,428 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699703669428"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703669428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703669428"}]},"ts":"1699703669428"} 2023-11-11 11:54:29,429 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 0cb4b137d2c1690927cb67dbaea29e17, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:29,581 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:29,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:29,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0cb4b137d2c1690927cb67dbaea29e17, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:54:29,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:29,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:29,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:29,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:29,585 INFO [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:29,586 DEBUG [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1 2023-11-11 11:54:29,586 DEBUG [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1 2023-11-11 11:54:29,587 INFO [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0cb4b137d2c1690927cb67dbaea29e17 columnFamilyName family1 2023-11-11 11:54:29,592 DEBUG [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/12c9bc601bd8449eb7435b7b0431dd5c 2023-11-11 11:54:29,596 DEBUG [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/34b92db7bb9d43f69b6cd3f915c6716b_SeqId_46_ 2023-11-11 11:54:29,599 DEBUG [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/76f66e4f3fea4f78a089b9b6fc8434e4 2023-11-11 11:54:29,599 INFO [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] regionserver.HStore(310): Store=0cb4b137d2c1690927cb67dbaea29e17/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:29,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:29,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:29,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:29,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0cb4b137d2c1690927cb67dbaea29e17; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62741312, jitterRate=-0.06508159637451172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:54:29,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:29,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17., pid=47, masterSystemTime=1699703669581 2023-11-11 11:54:29,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:29,606 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-11 11:54:29,607 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-11 11:54:29,607 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1912): 0cb4b137d2c1690927cb67dbaea29e17/family1 is initiating minor compaction (all files) 2023-11-11 11:54:29,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:29,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:29,608 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0cb4b137d2c1690927cb67dbaea29e17/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:29,608 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/12c9bc601bd8449eb7435b7b0431dd5c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/76f66e4f3fea4f78a089b9b6fc8434e4, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/34b92db7bb9d43f69b6cd3f915c6716b_SeqId_46_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp, totalSize=390.1 K 2023-11-11 11:54:29,608 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=0cb4b137d2c1690927cb67dbaea29e17, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:29,608 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 12c9bc601bd8449eb7435b7b0431dd5c, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824916 2023-11-11 11:54:29,608 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699703669608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703669608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703669608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703669608"}]},"ts":"1699703669608"} 2023-11-11 11:54:29,609 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 76f66e4f3fea4f78a089b9b6fc8434e4, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224916 2023-11-11 11:54:29,609 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 34b92db7bb9d43f69b6cd3f915c6716b_SeqId_46_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878824916 2023-11-11 11:54:29,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-11 11:54:29,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 0cb4b137d2c1690927cb67dbaea29e17, server=jenkins-hbase4.apache.org,41363,1699703601801 in 180 msec 2023-11-11 11:54:29,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-11 11:54:29,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0cb4b137d2c1690927cb67dbaea29e17, REOPEN/MOVE in 499 msec 2023-11-11 11:54:29,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-11 11:54:29,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 503 msec 2023-11-11 11:54:29,616 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 917 msec 2023-11-11 11:54:29,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-11 11:54:29,618 INFO [Listener at localhost/39241] compactions.TestMobCompactor(278): alter status finished 2023-11-11 11:54:29,619 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:29,623 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0cb4b137d2c1690927cb67dbaea29e17#family1#compaction#61 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-11 11:54:29,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 11:54:29,626 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 11:54:29,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:29,627 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704269627 2023-11-11 11:54:29,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 11:54:29,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-11 11:54:29,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 11:54:29,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x63f2fff4 to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:54:29,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ec95394, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:54:29,637 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:29,637 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:29,637 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:29,637 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:29,637 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:30,043 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/.tmp/family1/6d91c54d254b4cb183d00c276e7fa5bb as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/6d91c54d254b4cb183d00c276e7fa5bb 2023-11-11 11:54:30,048 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-11 11:54:30,048 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0cb4b137d2c1690927cb67dbaea29e17/family1 of 0cb4b137d2c1690927cb67dbaea29e17 into 6d91c54d254b4cb183d00c276e7fa5bb(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:54:30,048 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:30,048 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17., storeName=0cb4b137d2c1690927cb67dbaea29e17/family1, priority=13, startTime=1699703669605; duration=0sec 2023-11-11 11:54:30,048 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:30,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/12c9bc601bd8449eb7435b7b0431dd5c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/76f66e4f3fea4f78a089b9b6fc8434e4, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/34b92db7bb9d43f69b6cd3f915c6716b_SeqId_46_] to archive 2023-11-11 11:54:30,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:30,142 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/12c9bc601bd8449eb7435b7b0431dd5c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/12c9bc601bd8449eb7435b7b0431dd5c 2023-11-11 11:54:30,143 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/76f66e4f3fea4f78a089b9b6fc8434e4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/76f66e4f3fea4f78a089b9b6fc8434e4 2023-11-11 11:54:30,145 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/34b92db7bb9d43f69b6cd3f915c6716b_SeqId_46_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/34b92db7bb9d43f69b6cd3f915c6716b_SeqId_46_ 2023-11-11 11:54:30,462 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b93e9267f14e4e8495dcdffb4af44c50 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b93e9267f14e4e8495dcdffb4af44c50 2023-11-11 11:54:30,462 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 11:54:30,475 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:54:30,476 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:54:30,482 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:54:30,484 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:54:30,491 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b1c01367e12b45549e99e70be0b6385f first=Optional[r05] last=Optional[r8] 2023-11-11 11:54:30,492 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=50 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b1c01367e12b45549e99e70be0b6385f}] 2023-11-11 11:54:30,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b1c01367e12b45549e99e70be0b6385f for inclusion in 0cb4b137d2c1690927cb67dbaea29e17/family1 2023-11-11 11:54:30,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-11 11:54:30,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:54:30,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:30,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b1c01367e12b45549e99e70be0b6385f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hjivk1t7fl28a78omcklej7fdpspebetne7u5otbkuiqrdrkd6q1fqfrn0ihf94c/family1/b1c01367e12b45549e99e70be0b6385f 2023-11-11 11:54:30,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hjivk1t7fl28a78omcklej7fdpspebetne7u5otbkuiqrdrkd6q1fqfrn0ihf94c/family1/b1c01367e12b45549e99e70be0b6385f as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/9915148866a5404fada13806a5d8006b_SeqId_53_ 2023-11-11 11:54:30,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hjivk1t7fl28a78omcklej7fdpspebetne7u5otbkuiqrdrkd6q1fqfrn0ihf94c/family1/b1c01367e12b45549e99e70be0b6385f into 0cb4b137d2c1690927cb67dbaea29e17/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/9915148866a5404fada13806a5d8006b_SeqId_53_ - updating store file list. 2023-11-11 11:54:30,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/9915148866a5404fada13806a5d8006b_SeqId_53_ into 0cb4b137d2c1690927cb67dbaea29e17/family1 2023-11-11 11:54:30,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hjivk1t7fl28a78omcklej7fdpspebetne7u5otbkuiqrdrkd6q1fqfrn0ihf94c/family1/b1c01367e12b45549e99e70be0b6385f into 0cb4b137d2c1690927cb67dbaea29e17/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/9915148866a5404fada13806a5d8006b_SeqId_53_) 2023-11-11 11:54:30,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hjivk1t7fl28a78omcklej7fdpspebetne7u5otbkuiqrdrkd6q1fqfrn0ihf94c/family1/b1c01367e12b45549e99e70be0b6385f 2023-11-11 11:54:30,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 11:54:30,509 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:30,511 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511207951658d882940cf9d795d35adcf8681 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511207951658d882940cf9d795d35adcf8681 2023-11-11 11:54:30,512 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511283f59b6f6e5004503bc32233bec70330f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511283f59b6f6e5004503bc32233bec70330f 2023-11-11 11:54:30,512 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-11 11:54:30,512 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-11 11:54:30,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:30,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:30,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:30,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 11:54:30,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:30,514 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 11:54:30,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 894 msec 2023-11-11 11:54:30,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-11 11:54:30,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:30,979 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-11 11:54:30,980 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-11 11:54:30,980 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-11 11:54:30,982 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-11 11:54:30,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0cb4b137d2c1690927cb67dbaea29e17, REOPEN/MOVE}] 2023-11-11 11:54:30,985 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0cb4b137d2c1690927cb67dbaea29e17, REOPEN/MOVE 2023-11-11 11:54:30,985 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=0cb4b137d2c1690927cb67dbaea29e17, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:30,986 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699703670985"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703670985"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703670985"}]},"ts":"1699703670985"} 2023-11-11 11:54:30,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 0cb4b137d2c1690927cb67dbaea29e17, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:31,138 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:31,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:31,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0cb4b137d2c1690927cb67dbaea29e17, disabling compactions & flushes 2023-11-11 11:54:31,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:31,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:31,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. after waiting 0 ms 2023-11-11 11:54:31,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:31,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-11-11 11:54:31,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:31,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:31,145 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 0cb4b137d2c1690927cb67dbaea29e17 to self. 2023-11-11 11:54:31,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:31,147 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=0cb4b137d2c1690927cb67dbaea29e17, regionState=CLOSED 2023-11-11 11:54:31,147 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699703671147"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703671147"}]},"ts":"1699703671147"} 2023-11-11 11:54:31,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-11 11:54:31,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 0cb4b137d2c1690927cb67dbaea29e17, server=jenkins-hbase4.apache.org,41363,1699703601801 in 161 msec 2023-11-11 11:54:31,150 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0cb4b137d2c1690927cb67dbaea29e17, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=true 2023-11-11 11:54:31,300 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=0cb4b137d2c1690927cb67dbaea29e17, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:31,300 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699703671300"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703671300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703671300"}]},"ts":"1699703671300"} 2023-11-11 11:54:31,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 0cb4b137d2c1690927cb67dbaea29e17, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:31,453 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:31,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:31,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0cb4b137d2c1690927cb67dbaea29e17, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:54:31,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:31,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:31,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:31,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:31,458 INFO [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:31,458 DEBUG [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1 2023-11-11 11:54:31,458 DEBUG [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1 2023-11-11 11:54:31,459 INFO [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0cb4b137d2c1690927cb67dbaea29e17 columnFamilyName family1 2023-11-11 11:54:31,463 DEBUG [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/6d91c54d254b4cb183d00c276e7fa5bb 2023-11-11 11:54:31,467 DEBUG [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/family1/9915148866a5404fada13806a5d8006b_SeqId_53_ 2023-11-11 11:54:31,467 INFO [StoreOpener-0cb4b137d2c1690927cb67dbaea29e17-1] regionserver.HStore(310): Store=0cb4b137d2c1690927cb67dbaea29e17/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:31,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:31,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:31,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:54:31,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0cb4b137d2c1690927cb67dbaea29e17; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75277328, jitterRate=0.1217195987701416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:54:31,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:54:31,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17., pid=53, masterSystemTime=1699703671453 2023-11-11 11:54:31,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:31,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:54:31,474 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=0cb4b137d2c1690927cb67dbaea29e17, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:31,474 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699703671474"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703671474"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703671474"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703671474"}]},"ts":"1699703671474"} 2023-11-11 11:54:31,476 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-11 11:54:31,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 0cb4b137d2c1690927cb67dbaea29e17, server=jenkins-hbase4.apache.org,41363,1699703601801 in 173 msec 2023-11-11 11:54:31,478 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-11 11:54:31,478 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0cb4b137d2c1690927cb67dbaea29e17, REOPEN/MOVE in 493 msec 2023-11-11 11:54:31,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-11 11:54:31,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 496 msec 2023-11-11 11:54:31,481 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 911 msec 2023-11-11 11:54:31,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-11 11:54:31,483 INFO [Listener at localhost/39241] compactions.TestMobCompactor(278): alter status finished 2023-11-11 11:54:31,484 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-11 11:54:31,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 11:54:31,486 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 11:54:31,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:31,486 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704271486 2023-11-11 11:54:31,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 11:54:31,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-11 11:54:31,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 11:54:31,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x2cec7941 to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:54:31,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@687ddabb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:54:31,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:31,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:31,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:31,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:31,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:31,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:31,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:31,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-11 11:54:31,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-11 11:54:31,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:31,496 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-11 11:54:31,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 11 msec 2023-11-11 11:54:31,541 INFO [Listener at localhost/39241] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=248 (was 258), OpenFileDescriptor=645 (was 644) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=161 (was 208), ProcessCount=170 (was 170), AvailableMemoryMB=2142 (was 2149) 2023-11-11 11:54:31,552 INFO [Listener at localhost/39241] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=248, OpenFileDescriptor=645, MaxFileDescriptor=60000, SystemLoadAverage=161, ProcessCount=170, AvailableMemoryMB=2141 2023-11-11 11:54:31,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-11 11:54:31,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:31,555 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 11:54:31,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-11 11:54:31,556 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 11:54:31,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-11 11:54:31,557 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:31,558 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21 empty. 2023-11-11 11:54:31,558 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:31,558 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-11 11:54:31,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-11 11:54:31,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-11 11:54:31,966 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-11 11:54:31,967 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 03486b38e1a188d7eb7cb528e5cecc21, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:54:32,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-11 11:54:32,373 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:32,373 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 03486b38e1a188d7eb7cb528e5cecc21, disabling compactions & flushes 2023-11-11 11:54:32,373 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:32,373 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:32,373 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. after waiting 0 ms 2023-11-11 11:54:32,373 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:32,373 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:32,373 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:32,375 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 11:54:32,376 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699703672376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703672376"}]},"ts":"1699703672376"} 2023-11-11 11:54:32,377 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 11:54:32,378 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 11:54:32,378 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703672378"}]},"ts":"1699703672378"} 2023-11-11 11:54:32,379 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-11 11:54:32,383 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=03486b38e1a188d7eb7cb528e5cecc21, ASSIGN}] 2023-11-11 11:54:32,384 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=03486b38e1a188d7eb7cb528e5cecc21, ASSIGN 2023-11-11 11:54:32,385 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=03486b38e1a188d7eb7cb528e5cecc21, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:54:32,536 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=03486b38e1a188d7eb7cb528e5cecc21, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:32,536 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699703672536"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703672536"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703672536"}]},"ts":"1699703672536"} 2023-11-11 11:54:32,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 03486b38e1a188d7eb7cb528e5cecc21, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:32,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-11 11:54:32,688 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:32,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:32,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 03486b38e1a188d7eb7cb528e5cecc21, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:54:32,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:32,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:32,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:32,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:32,693 INFO [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:32,694 DEBUG [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1 2023-11-11 11:54:32,694 DEBUG [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1 2023-11-11 11:54:32,694 INFO [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03486b38e1a188d7eb7cb528e5cecc21 columnFamilyName family1 2023-11-11 11:54:32,695 INFO [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] regionserver.HStore(310): Store=03486b38e1a188d7eb7cb528e5cecc21/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:32,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:32,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:32,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:32,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:54:32,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 03486b38e1a188d7eb7cb528e5cecc21; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64020514, jitterRate=-0.04602000117301941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:54:32,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:32,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21., pid=57, masterSystemTime=1699703672688 2023-11-11 11:54:32,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:32,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:32,704 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=03486b38e1a188d7eb7cb528e5cecc21, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:32,704 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699703672703"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703672703"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703672703"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703672703"}]},"ts":"1699703672703"} 2023-11-11 11:54:32,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-11 11:54:32,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 03486b38e1a188d7eb7cb528e5cecc21, server=jenkins-hbase4.apache.org,41363,1699703601801 in 168 msec 2023-11-11 11:54:32,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-11 11:54:32,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=03486b38e1a188d7eb7cb528e5cecc21, ASSIGN in 323 msec 2023-11-11 11:54:32,708 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 11:54:32,708 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703672708"}]},"ts":"1699703672708"} 2023-11-11 11:54:32,709 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-11 11:54:32,711 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 11:54:32,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1580 sec 2023-11-11 11:54:33,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-11 11:54:33,661 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-11 11:54:33,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:33,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:33,680 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:33,680 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:33,680 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 11:54:33,680 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 11:54:33,680 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:33,680 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:33,682 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:33,682 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:33,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:33,682 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:33,682 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:33,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:33,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:33,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:33,683 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:33,683 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:33,683 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 11:54:33,684 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:33,684 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 11:54:33,685 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:33,685 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:33,685 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:33,685 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. started... 2023-11-11 11:54:33,685 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 03486b38e1a188d7eb7cb528e5cecc21 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 11:54:34,106 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f21f68897bc640689cc343ba2211d944 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130f21f68897bc640689cc343ba2211d944 2023-11-11 11:54:34,510 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/41a9e7e838e9478f99fd62b07589a974 2023-11-11 11:54:34,517 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/41a9e7e838e9478f99fd62b07589a974 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/41a9e7e838e9478f99fd62b07589a974 2023-11-11 11:54:34,521 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/41a9e7e838e9478f99fd62b07589a974, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-11 11:54:34,522 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 03486b38e1a188d7eb7cb528e5cecc21 in 837ms, sequenceid=5, compaction requested=false 2023-11-11 11:54:34,522 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:34,523 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:34,523 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:34,523 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:34,523 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:34,523 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,523 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 11:54:34,523 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 11:54:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,525 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:34,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:34,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:34,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:34,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:34,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 11:54:34,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a78026f[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:34,527 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 11:54:34,527 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,529 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,529 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 11:54:34,529 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 11:54:34,529 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:34,529 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,529 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:34,530 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,530 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 11:54:34,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:34,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:34,531 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:34,531 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 11:54:34,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:34,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:34,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:34,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:34,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 11:54:34,534 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 11:54:34,534 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:34,534 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:34,534 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,534 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:34,539 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:34,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:34,539 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,539 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:34,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:34,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:34,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:34,540 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:34,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,541 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:34,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,544 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:34,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:34,544 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:34,544 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:34,544 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,544 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,544 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,544 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,544 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,544 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,544 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:34,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:34,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:34,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:34,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:34,545 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:34,545 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:34,645 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:34,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:34,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:34,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:34,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,651 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:34,651 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:34,651 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 11:54:34,651 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 11:54:34,652 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,652 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,653 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,653 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:34,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:34,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:34,653 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:34,653 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:34,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:34,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,654 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,655 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 11:54:34,655 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:34,655 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 11:54:34,655 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:34,655 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 11:54:34,655 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:34,655 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:34,655 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:34,655 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. started... 2023-11-11 11:54:34,655 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 03486b38e1a188d7eb7cb528e5cecc21 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 11:54:34,804 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 11:54:35,070 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128530c7943848c45ecaed58cd6ed41b5a0 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128530c7943848c45ecaed58cd6ed41b5a0 2023-11-11 11:54:35,476 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/7c58dc24f59e4dcd97505f8dc24205a1 2023-11-11 11:54:35,480 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/7c58dc24f59e4dcd97505f8dc24205a1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/7c58dc24f59e4dcd97505f8dc24205a1 2023-11-11 11:54:35,484 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/7c58dc24f59e4dcd97505f8dc24205a1, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 11:54:35,485 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 03486b38e1a188d7eb7cb528e5cecc21 in 830ms, sequenceid=9, compaction requested=false 2023-11-11 11:54:35,485 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:35,485 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:35,485 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:35,485 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:35,485 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,486 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 11:54:35,486 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 11:54:35,487 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,487 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:35,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:35,487 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,487 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:35,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:35,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:35,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:35,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 11:54:35,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69b72d43[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:35,489 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 11:54:35,489 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,491 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,491 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 11:54:35,491 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 11:54:35,492 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:35,492 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,492 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:35,494 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,494 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 11:54:35,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:35,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:35,494 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:35,494 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 11:54:35,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:35,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:35,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:35,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:35,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 11:54:35,496 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 11:54:35,496 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:35,496 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:35,496 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,496 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:35,498 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,498 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,498 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:35,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:35,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:35,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:35,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:35,498 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:35,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:35,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,500 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:35,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,502 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,502 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,502 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:35,502 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:35,502 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:35,502 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:35,502 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,502 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:35,502 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:35,502 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:35,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:35,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:35,502 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:35,503 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:35,603 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:35,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:35,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:35,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:35,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,608 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:35,608 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:35,608 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 11:54:35,608 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 11:54:35,609 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,609 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,611 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:35,611 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:35,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:35,611 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:35,611 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:35,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:35,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,612 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,612 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 11:54:35,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:35,612 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 11:54:35,612 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:35,612 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 11:54:35,612 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:35,612 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:35,612 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:35,613 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. started... 2023-11-11 11:54:35,613 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 03486b38e1a188d7eb7cb528e5cecc21 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:36,025 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e844d3da11eb47b6925cc70541c8a645 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201e844d3da11eb47b6925cc70541c8a645 2023-11-11 11:54:36,430 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/199f002dc6f2486b9a9cf74a134ddd2f 2023-11-11 11:54:36,434 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/199f002dc6f2486b9a9cf74a134ddd2f as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/199f002dc6f2486b9a9cf74a134ddd2f 2023-11-11 11:54:36,438 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/199f002dc6f2486b9a9cf74a134ddd2f, entries=1, sequenceid=13, filesize=5.0 K 2023-11-11 11:54:36,439 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 03486b38e1a188d7eb7cb528e5cecc21 in 826ms, sequenceid=13, compaction requested=true 2023-11-11 11:54:36,439 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:36,439 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:36,439 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:36,439 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:36,439 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,439 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 11:54:36,439 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 11:54:36,441 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,441 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:36,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:36,441 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,441 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:36,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:36,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:36,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:36,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 11:54:36,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49c7dc61[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:36,443 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 11:54:36,443 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,444 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,444 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,445 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:36,444 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 11:54:36,445 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 11:54:36,445 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:36,446 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,446 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 11:54:36,446 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:36,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:36,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:36,446 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 11:54:36,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:36,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:36,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:36,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:36,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 11:54:36,449 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 11:54:36,449 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:36,449 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:36,449 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,449 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:36,451 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,451 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:36,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:36,451 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:36,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:36,452 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:36,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:36,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:36,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,453 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:36,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,457 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,458 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,458 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:36,458 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:36,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-11 11:54:36,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:36,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:36,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:36,458 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:36,458 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,458 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:36,458 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,458 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,458 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,458 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:36,458 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:36,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:36,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:36,558 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:36,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:36,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:36,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:36,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,564 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:36,564 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:36,564 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 11:54:36,564 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 11:54:36,565 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,565 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,569 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,569 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:36,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:36,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:36,570 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:36,570 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:36,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:36,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,570 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,571 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 11:54:36,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:36,571 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 11:54:36,571 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:36,571 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 11:54:36,571 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:36,571 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:36,571 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:36,571 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. started... 2023-11-11 11:54:36,571 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 03486b38e1a188d7eb7cb528e5cecc21 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:36,983 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205dbb775f892364dde9edcd76e41a8e6fb to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205dbb775f892364dde9edcd76e41a8e6fb 2023-11-11 11:54:37,389 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/e78d580c40844bceafada038849d3f8b 2023-11-11 11:54:37,393 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/e78d580c40844bceafada038849d3f8b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/e78d580c40844bceafada038849d3f8b 2023-11-11 11:54:37,397 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/e78d580c40844bceafada038849d3f8b, entries=1, sequenceid=17, filesize=5.0 K 2023-11-11 11:54:37,398 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 03486b38e1a188d7eb7cb528e5cecc21 in 827ms, sequenceid=17, compaction requested=true 2023-11-11 11:54:37,398 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:37,398 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:37,398 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:37,398 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:37,398 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,398 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 11:54:37,398 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 11:54:37,401 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,401 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:37,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:37,401 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,401 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:37,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:37,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:37,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:37,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 11:54:37,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28d4f03e[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:37,403 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 11:54:37,403 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,404 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,404 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 11:54:37,404 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 11:54:37,404 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:37,404 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,405 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:37,406 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 11:54:37,406 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,406 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:37,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:37,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:37,406 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 11:54:37,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:37,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:37,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:37,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:37,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 11:54:37,409 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 11:54:37,409 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:37,409 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:37,409 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,409 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:37,411 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,411 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:37,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,411 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:37,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:37,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:37,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:37,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:37,412 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:37,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,413 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:37,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,416 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,416 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:37,416 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,416 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:37,416 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:37,416 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:37,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:37,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:37,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:37,416 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,417 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,417 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,417 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,417 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:37,417 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:37,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:37,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:37,517 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:37,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:37,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:37,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:37,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,523 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:37,523 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:37,523 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 11:54:37,523 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 11:54:37,523 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,524 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,525 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,525 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:37,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:37,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:37,525 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:37,525 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:37,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:37,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,526 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,526 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 11:54:37,526 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:37,526 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 11:54:37,526 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:37,526 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 11:54:37,527 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:37,527 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:37,527 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:37,527 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. started... 2023-11-11 11:54:37,527 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 03486b38e1a188d7eb7cb528e5cecc21 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:37,938 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228060c670971214286a7c07a52d2dffe9b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228060c670971214286a7c07a52d2dffe9b 2023-11-11 11:54:38,343 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/331aefc4bc5d470e85624c91526bfa63 2023-11-11 11:54:38,348 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/331aefc4bc5d470e85624c91526bfa63 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/331aefc4bc5d470e85624c91526bfa63 2023-11-11 11:54:38,351 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/331aefc4bc5d470e85624c91526bfa63, entries=1, sequenceid=21, filesize=5.0 K 2023-11-11 11:54:38,352 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 03486b38e1a188d7eb7cb528e5cecc21 in 825ms, sequenceid=21, compaction requested=true 2023-11-11 11:54:38,352 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:38,352 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:38,352 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:38,352 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:38,352 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,352 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 11:54:38,352 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 11:54:38,354 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,354 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:38,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:38,354 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,354 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:38,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:38,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:38,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:38,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 11:54:38,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4255f431[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:38,356 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 11:54:38,356 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,357 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,357 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 11:54:38,357 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 11:54:38,357 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:38,357 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,357 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:38,360 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,360 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 11:54:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:38,360 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:38,360 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 11:54:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:38,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 11:54:38,362 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 11:54:38,362 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:38,362 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:38,362 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,362 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:38,364 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,364 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:38,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,364 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:38,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:38,364 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,365 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,368 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,368 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:38,368 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,368 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:38,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:38,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:38,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:38,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:38,368 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:38,368 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,368 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,368 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,369 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:38,369 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:38,369 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:38,369 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:38,469 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:38,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:38,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:38,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:38,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,474 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:38,475 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:38,475 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 11:54:38,475 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 11:54:38,475 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,475 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,476 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:38,476 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:38,477 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:38,477 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,477 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,477 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 11:54:38,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:38,478 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 11:54:38,478 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:38,478 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 11:54:38,478 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:38,478 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:38,478 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:38,478 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. started... 2023-11-11 11:54:38,478 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 03486b38e1a188d7eb7cb528e5cecc21 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:38,889 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d6a0a7b4ab914be5af4e977e3847ec06 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231d6a0a7b4ab914be5af4e977e3847ec06 2023-11-11 11:54:39,294 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/14098ef605f144b0b6d80be01dcacce0 2023-11-11 11:54:39,299 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/14098ef605f144b0b6d80be01dcacce0 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/14098ef605f144b0b6d80be01dcacce0 2023-11-11 11:54:39,302 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/14098ef605f144b0b6d80be01dcacce0, entries=1, sequenceid=25, filesize=5.0 K 2023-11-11 11:54:39,303 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 03486b38e1a188d7eb7cb528e5cecc21 in 825ms, sequenceid=25, compaction requested=true 2023-11-11 11:54:39,303 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:39,303 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:39,303 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:39,303 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:39,303 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,303 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 11:54:39,303 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 11:54:39,306 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,306 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:39,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:39,306 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,306 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:39,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:39,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:39,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:39,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 11:54:39,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1258140d[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:39,307 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 11:54:39,308 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,309 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,309 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 11:54:39,309 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 11:54:39,309 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:39,309 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,309 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:39,310 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,310 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 11:54:39,310 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:39,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:39,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:39,310 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 11:54:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:39,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:39,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 11:54:39,313 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 11:54:39,313 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:39,313 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:39,313 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,313 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:39,315 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,315 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:39,315 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:39,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:39,316 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:39,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,317 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:39,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,321 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,321 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:39,321 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,321 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:39,321 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,321 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,321 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,321 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:39,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:39,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:39,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:39,321 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:39,321 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-11 11:54:39,321 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:39,322 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:39,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:39,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:39,422 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:39,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:39,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:39,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:39,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,428 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:39,428 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:39,428 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 11:54:39,428 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 11:54:39,429 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,429 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,430 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:39,430 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:39,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:39,430 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,430 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:39,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:39,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,431 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,431 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 11:54:39,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,431 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 11:54:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 11:54:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:39,432 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:39,432 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. started... 2023-11-11 11:54:39,432 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 03486b38e1a188d7eb7cb528e5cecc21 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:39,444 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f57b7d56cf4441dc9c72e87c8537d7f0 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101f57b7d56cf4441dc9c72e87c8537d7f0 2023-11-11 11:54:39,849 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/cfb42270c9a04336b42695f88c6bd506 2023-11-11 11:54:39,855 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/cfb42270c9a04336b42695f88c6bd506 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/cfb42270c9a04336b42695f88c6bd506 2023-11-11 11:54:39,859 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/cfb42270c9a04336b42695f88c6bd506, entries=1, sequenceid=29, filesize=5.0 K 2023-11-11 11:54:39,860 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 03486b38e1a188d7eb7cb528e5cecc21 in 428ms, sequenceid=29, compaction requested=true 2023-11-11 11:54:39,860 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:39,860 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 11:54:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 11:54:39,862 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,862 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:39,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:39,862 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,862 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:39,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:39,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:39,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:39,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 11:54:39,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@650bf6f3[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:39,864 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 11:54:39,864 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,865 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,865 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 11:54:39,865 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 11:54:39,865 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:39,865 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,865 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:39,867 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,867 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 11:54:39,868 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:39,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:39,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:39,868 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 11:54:39,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:39,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:39,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:39,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:39,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 11:54:39,870 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 11:54:39,870 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:39,870 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:39,870 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,870 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:39,872 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,872 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:39,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,872 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:39,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:39,872 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,874 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:39,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:39,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:39,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:39,876 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:39,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:39,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:39,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:39,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,876 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,877 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:39,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:39,877 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:39,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:39,977 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:39,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:39,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:39,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:39,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,983 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:39,984 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:39,984 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 11:54:39,984 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 11:54:39,984 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,984 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,985 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:39,985 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:39,986 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:39,986 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:39,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:39,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,987 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,987 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 11:54:39,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:39,987 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 11:54:39,987 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:39,987 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 11:54:39,987 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:39,987 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:39,987 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:39,988 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. started... 2023-11-11 11:54:39,988 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 03486b38e1a188d7eb7cb528e5cecc21 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:40,407 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d82fde922e814d2db200f54dae137f82 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103d82fde922e814d2db200f54dae137f82 2023-11-11 11:54:40,812 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/0c2f6b9006d347369b1b064ced68385b 2023-11-11 11:54:40,817 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/0c2f6b9006d347369b1b064ced68385b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/0c2f6b9006d347369b1b064ced68385b 2023-11-11 11:54:40,820 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/0c2f6b9006d347369b1b064ced68385b, entries=1, sequenceid=33, filesize=5.0 K 2023-11-11 11:54:40,821 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 03486b38e1a188d7eb7cb528e5cecc21 in 833ms, sequenceid=33, compaction requested=true 2023-11-11 11:54:40,821 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:40,821 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:40,821 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:40,821 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:40,821 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,821 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 11:54:40,821 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 11:54:40,824 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,824 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:40,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:40,824 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,824 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:40,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:40,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:40,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:40,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 11:54:40,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a51bf6c[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:40,825 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 11:54:40,825 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,827 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,827 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 11:54:40,827 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 11:54:40,827 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:40,827 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,827 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:40,830 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,830 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 11:54:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:40,831 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:40,831 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 11:54:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:40,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:40,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 11:54:40,833 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 11:54:40,833 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:40,833 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:40,833 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,833 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:40,835 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:40,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:40,835 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,835 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:40,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:40,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:40,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:40,836 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:40,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,837 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:40,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,839 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,840 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,840 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:40,840 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:40,840 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:40,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:40,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:40,840 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:40,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:40,840 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,840 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,840 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,840 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,840 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:40,840 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:40,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:40,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:40,940 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:40,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:40,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:40,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:40,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,947 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:40,947 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:40,947 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 11:54:40,947 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 11:54:40,948 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,948 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,949 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:40,949 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:40,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:40,950 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:40,950 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:40,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:40,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,951 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,951 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 11:54:40,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:40,951 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 11:54:40,951 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:40,952 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 11:54:40,952 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:40,952 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:40,952 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:40,952 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. started... 2023-11-11 11:54:40,952 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 03486b38e1a188d7eb7cb528e5cecc21 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:41,370 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907651bb18ba9e642be83ed8a38058bbf05 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907651bb18ba9e642be83ed8a38058bbf05 2023-11-11 11:54:41,776 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/8d3e3215d6814b0f9903fe4421f93a59 2023-11-11 11:54:41,780 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/8d3e3215d6814b0f9903fe4421f93a59 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8d3e3215d6814b0f9903fe4421f93a59 2023-11-11 11:54:41,784 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8d3e3215d6814b0f9903fe4421f93a59, entries=1, sequenceid=37, filesize=5.0 K 2023-11-11 11:54:41,785 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 03486b38e1a188d7eb7cb528e5cecc21 in 833ms, sequenceid=37, compaction requested=true 2023-11-11 11:54:41,785 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:41,785 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:41,785 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:41,785 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:41,785 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,785 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 11:54:41,785 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 11:54:41,788 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,788 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:41,788 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,788 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:41,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 11:54:41,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7482a6b[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:41,790 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 11:54:41,790 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,792 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,792 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 11:54:41,792 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 11:54:41,792 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:41,792 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,792 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:41,794 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,794 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 11:54:41,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:41,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:41,794 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:41,794 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 11:54:41,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:41,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:41,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:41,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:41,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 11:54:41,796 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 11:54:41,796 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:41,796 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:41,796 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,796 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:41,798 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,798 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:41,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,798 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:41,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:41,798 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,800 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:41,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,802 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,802 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,802 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:41,802 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,802 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:41,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:41,802 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:41,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:41,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:41,802 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:41,802 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,803 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,803 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:41,803 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:41,803 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:41,903 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:41,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:41,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:41,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:41,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,909 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:41,909 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:41,909 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-11 11:54:41,909 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-11 11:54:41,910 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,910 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,912 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,912 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:41,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:41,912 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:41,912 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:41,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,913 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,913 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-11 11:54:41,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-11 11:54:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-11 11:54:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:54:41,913 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:41,913 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:41,913 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. started... 2023-11-11 11:54:41,914 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 03486b38e1a188d7eb7cb528e5cecc21 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:54:42,325 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511209baa0cd5d7a948ecb965c1862c3cd282 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511209baa0cd5d7a948ecb965c1862c3cd282 2023-11-11 11:54:42,731 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/bbb809e156144bc2a2f0d35fb98c4d26 2023-11-11 11:54:42,735 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/bbb809e156144bc2a2f0d35fb98c4d26 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/bbb809e156144bc2a2f0d35fb98c4d26 2023-11-11 11:54:42,739 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/bbb809e156144bc2a2f0d35fb98c4d26, entries=1, sequenceid=41, filesize=5.0 K 2023-11-11 11:54:42,740 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 03486b38e1a188d7eb7cb528e5cecc21 in 826ms, sequenceid=41, compaction requested=true 2023-11-11 11:54:42,740 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:42,740 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:42,740 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:54:42,741 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:54:42,741 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,741 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-11 11:54:42,741 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-11 11:54:42,742 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:42,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:42,742 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:42,743 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,743 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:42,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:42,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:42,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-11 11:54:42,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55e2aef3[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:42,744 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-11 11:54:42,744 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,745 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,745 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-11 11:54:42,746 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-11 11:54:42,746 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,746 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:42,746 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:42,747 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,747 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-11 11:54:42,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:42,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:42,747 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:42,747 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-11 11:54:42,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:42,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:42,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:42,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:42,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-11 11:54:42,750 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-11 11:54:42,750 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:42,750 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:42,750 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,750 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:42,753 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,753 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:42,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:42,753 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:42,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:42,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:42,753 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:42,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:42,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,755 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:42,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:42,760 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:42,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-11 11:54:42,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:42,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-11 11:54:42,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:42,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:42,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:42,761 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,761 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,761 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,761 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:42,761 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:42,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:42,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:42,861 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:42,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:42,863 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:42,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 11:54:42,865 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 11:54:42,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:42,865 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704282865 2023-11-11 11:54:42,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 11:54:42,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-11 11:54:42,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 11:54:42,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x284fe02d to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:54:42,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46ef9e7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:54:42,874 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:43,329 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b9c52eb824b94ce5b3d84aa0b0cdae1a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103b9c52eb824b94ce5b3d84aa0b0cdae1a 2023-11-11 11:54:43,330 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 11:54:43,343 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:54:43,344 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:54:43,351 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:54:43,352 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:54:43,359 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cda14fde6aa74535bdc9b1fcb29eb922 first=Optional[r3] last=Optional[r6] 2023-11-11 11:54:43,360 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cda14fde6aa74535bdc9b1fcb29eb922}] 2023-11-11 11:54:43,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cda14fde6aa74535bdc9b1fcb29eb922 for inclusion in 03486b38e1a188d7eb7cb528e5cecc21/family1 2023-11-11 11:54:43,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-11 11:54:43,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:54:43,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:43,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cda14fde6aa74535bdc9b1fcb29eb922 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__51234efhm91vql6o71nuh14u1ahed6c6g33eifv4p111spbaohmnm2768r4g47lb/family1/cda14fde6aa74535bdc9b1fcb29eb922 2023-11-11 11:54:43,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__51234efhm91vql6o71nuh14u1ahed6c6g33eifv4p111spbaohmnm2768r4g47lb/family1/cda14fde6aa74535bdc9b1fcb29eb922 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/52e22648419a4218b02b6464b7bde767_SeqId_44_ 2023-11-11 11:54:43,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__51234efhm91vql6o71nuh14u1ahed6c6g33eifv4p111spbaohmnm2768r4g47lb/family1/cda14fde6aa74535bdc9b1fcb29eb922 into 03486b38e1a188d7eb7cb528e5cecc21/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/52e22648419a4218b02b6464b7bde767_SeqId_44_ - updating store file list. 2023-11-11 11:54:43,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/52e22648419a4218b02b6464b7bde767_SeqId_44_ into 03486b38e1a188d7eb7cb528e5cecc21/family1 2023-11-11 11:54:43,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__51234efhm91vql6o71nuh14u1ahed6c6g33eifv4p111spbaohmnm2768r4g47lb/family1/cda14fde6aa74535bdc9b1fcb29eb922 into 03486b38e1a188d7eb7cb528e5cecc21/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/52e22648419a4218b02b6464b7bde767_SeqId_44_) 2023-11-11 11:54:43,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__51234efhm91vql6o71nuh14u1ahed6c6g33eifv4p111spbaohmnm2768r4g47lb/family1/cda14fde6aa74535bdc9b1fcb29eb922 2023-11-11 11:54:43,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 11:54:43,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 11:54:43,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(1912): 03486b38e1a188d7eb7cb528e5cecc21/family1 is initiating minor compaction 2023-11-11 11:54:43,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3528d6d2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:43,376 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 03486b38e1a188d7eb7cb528e5cecc21/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:43,376 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/7c58dc24f59e4dcd97505f8dc24205a1, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/199f002dc6f2486b9a9cf74a134ddd2f, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/e78d580c40844bceafada038849d3f8b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/331aefc4bc5d470e85624c91526bfa63, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/14098ef605f144b0b6d80be01dcacce0, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/cfb42270c9a04336b42695f88c6bd506, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/0c2f6b9006d347369b1b064ced68385b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8d3e3215d6814b0f9903fe4421f93a59, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/bbb809e156144bc2a2f0d35fb98c4d26, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/52e22648419a4218b02b6464b7bde767_SeqId_44_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp, totalSize=50.3 K 2023-11-11 11:54:43,376 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 7c58dc24f59e4dcd97505f8dc24205a1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 11:54:43,377 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 199f002dc6f2486b9a9cf74a134ddd2f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 11:54:43,377 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting e78d580c40844bceafada038849d3f8b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 11:54:43,377 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 331aefc4bc5d470e85624c91526bfa63, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 11:54:43,377 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 14098ef605f144b0b6d80be01dcacce0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 11:54:43,377 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting cfb42270c9a04336b42695f88c6bd506, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 11:54:43,377 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 0c2f6b9006d347369b1b064ced68385b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 11:54:43,377 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 8d3e3215d6814b0f9903fe4421f93a59, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 11:54:43,377 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting bbb809e156144bc2a2f0d35fb98c4d26, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 11:54:43,377 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 52e22648419a4218b02b6464b7bde767_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 11:54:43,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 11:54:43,379 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:43,380 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228060c670971214286a7c07a52d2dffe9b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228060c670971214286a7c07a52d2dffe9b 2023-11-11 11:54:43,381 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231d6a0a7b4ab914be5af4e977e3847ec06 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231d6a0a7b4ab914be5af4e977e3847ec06 2023-11-11 11:54:43,383 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101f57b7d56cf4441dc9c72e87c8537d7f0 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101f57b7d56cf4441dc9c72e87c8537d7f0 2023-11-11 11:54:43,384 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103d82fde922e814d2db200f54dae137f82 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103d82fde922e814d2db200f54dae137f82 2023-11-11 11:54:43,384 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-11 11:54:43,384 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-11 11:54:43,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:43,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:43,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:43,384 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:43,385 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:43,385 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:43,385 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:43,385 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:43,411 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): 03486b38e1a188d7eb7cb528e5cecc21#family1#compaction#72 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-11 11:54:43,830 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052a5e3061c31d458287dfc9e09f73c376 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052a5e3061c31d458287dfc9e09f73c376 2023-11-11 11:54:43,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 11:54:43,856 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/24346e64c56d4f8ba7fbc8b6cf55f0ac first=Optional[r00] last=Optional[r2] 2023-11-11 11:54:43,857 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/24346e64c56d4f8ba7fbc8b6cf55f0ac}] 2023-11-11 11:54:43,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/24346e64c56d4f8ba7fbc8b6cf55f0ac for inclusion in 03486b38e1a188d7eb7cb528e5cecc21/family1 2023-11-11 11:54:43,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-11 11:54:43,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:54:43,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:43,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/24346e64c56d4f8ba7fbc8b6cf55f0ac to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ftlevj4c48djjhb4tmh4ljj6culu1aovse9anm4pek176gnmjpl9q8dtd3p5veli/family1/24346e64c56d4f8ba7fbc8b6cf55f0ac 2023-11-11 11:54:43,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ftlevj4c48djjhb4tmh4ljj6culu1aovse9anm4pek176gnmjpl9q8dtd3p5veli/family1/24346e64c56d4f8ba7fbc8b6cf55f0ac as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8f52770aff884cbdaccfd273cdbf7188_SeqId_46_ 2023-11-11 11:54:43,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ftlevj4c48djjhb4tmh4ljj6culu1aovse9anm4pek176gnmjpl9q8dtd3p5veli/family1/24346e64c56d4f8ba7fbc8b6cf55f0ac into 03486b38e1a188d7eb7cb528e5cecc21/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8f52770aff884cbdaccfd273cdbf7188_SeqId_46_ - updating store file list. 2023-11-11 11:54:43,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8f52770aff884cbdaccfd273cdbf7188_SeqId_46_ into 03486b38e1a188d7eb7cb528e5cecc21/family1 2023-11-11 11:54:43,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ftlevj4c48djjhb4tmh4ljj6culu1aovse9anm4pek176gnmjpl9q8dtd3p5veli/family1/24346e64c56d4f8ba7fbc8b6cf55f0ac into 03486b38e1a188d7eb7cb528e5cecc21/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8f52770aff884cbdaccfd273cdbf7188_SeqId_46_) 2023-11-11 11:54:43,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ftlevj4c48djjhb4tmh4ljj6culu1aovse9anm4pek176gnmjpl9q8dtd3p5veli/family1/24346e64c56d4f8ba7fbc8b6cf55f0ac 2023-11-11 11:54:43,871 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 11:54:43,872 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:43,873 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130f21f68897bc640689cc343ba2211d944 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130f21f68897bc640689cc343ba2211d944 2023-11-11 11:54:43,874 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201e844d3da11eb47b6925cc70541c8a645 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201e844d3da11eb47b6925cc70541c8a645 2023-11-11 11:54:43,875 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205dbb775f892364dde9edcd76e41a8e6fb to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205dbb775f892364dde9edcd76e41a8e6fb 2023-11-11 11:54:43,875 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-11 11:54:43,875 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-11 11:54:43,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:43,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 11:54:43,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:43,877 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 11:54:43,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.0140 sec 2023-11-11 11:54:43,934 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:54:43,934 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x466cea95 to 127.0.0.1:59344 2023-11-11 11:54:43,934 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:54:43,934 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:54:43,934 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x284fe02d to 127.0.0.1:59344 2023-11-11 11:54:43,935 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:54:43,935 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:54:43,935 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x209b07e6 to 127.0.0.1:59344 2023-11-11 11:54:43,935 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:54:43,935 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:54:43,935 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63f2fff4 to 127.0.0.1:59344 2023-11-11 11:54:43,935 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:54:43,935 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cec7941 to 127.0.0.1:59344 2023-11-11 11:54:43,935 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:54:43,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-11 11:54:43,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:44,225 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/3f6f8006eb4749e5bd2c0f9812ef0de0 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/3f6f8006eb4749e5bd2c0f9812ef0de0 2023-11-11 11:54:44,229 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 03486b38e1a188d7eb7cb528e5cecc21/family1 of 03486b38e1a188d7eb7cb528e5cecc21 into 3f6f8006eb4749e5bd2c0f9812ef0de0(size=6.8 K), total size for store is 388.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:54:44,229 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:44,229 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699703683376; duration=0sec 2023-11-11 11:54:44,229 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:44,241 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/7c58dc24f59e4dcd97505f8dc24205a1, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/199f002dc6f2486b9a9cf74a134ddd2f, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/e78d580c40844bceafada038849d3f8b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/331aefc4bc5d470e85624c91526bfa63, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/14098ef605f144b0b6d80be01dcacce0, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/cfb42270c9a04336b42695f88c6bd506, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/0c2f6b9006d347369b1b064ced68385b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8d3e3215d6814b0f9903fe4421f93a59, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/bbb809e156144bc2a2f0d35fb98c4d26, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/52e22648419a4218b02b6464b7bde767_SeqId_44_] to archive 2023-11-11 11:54:44,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:44,243 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/7c58dc24f59e4dcd97505f8dc24205a1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/7c58dc24f59e4dcd97505f8dc24205a1 2023-11-11 11:54:44,244 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/199f002dc6f2486b9a9cf74a134ddd2f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/199f002dc6f2486b9a9cf74a134ddd2f 2023-11-11 11:54:44,245 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/e78d580c40844bceafada038849d3f8b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/e78d580c40844bceafada038849d3f8b 2023-11-11 11:54:44,247 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/331aefc4bc5d470e85624c91526bfa63 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/331aefc4bc5d470e85624c91526bfa63 2023-11-11 11:54:44,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/14098ef605f144b0b6d80be01dcacce0 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/14098ef605f144b0b6d80be01dcacce0 2023-11-11 11:54:44,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/cfb42270c9a04336b42695f88c6bd506 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/cfb42270c9a04336b42695f88c6bd506 2023-11-11 11:54:44,250 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/0c2f6b9006d347369b1b064ced68385b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/0c2f6b9006d347369b1b064ced68385b 2023-11-11 11:54:44,251 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8d3e3215d6814b0f9903fe4421f93a59 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8d3e3215d6814b0f9903fe4421f93a59 2023-11-11 11:54:44,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/bbb809e156144bc2a2f0d35fb98c4d26 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/bbb809e156144bc2a2f0d35fb98c4d26 2023-11-11 11:54:44,253 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/52e22648419a4218b02b6464b7bde767_SeqId_44_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/52e22648419a4218b02b6464b7bde767_SeqId_44_ 2023-11-11 11:54:44,382 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-11 11:54:44,383 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-11 11:54:44,383 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-11 11:54:44,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-11 11:54:44,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=03486b38e1a188d7eb7cb528e5cecc21, REOPEN/MOVE}] 2023-11-11 11:54:44,388 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=03486b38e1a188d7eb7cb528e5cecc21, REOPEN/MOVE 2023-11-11 11:54:44,388 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=03486b38e1a188d7eb7cb528e5cecc21, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:44,389 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699703684388"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703684388"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703684388"}]},"ts":"1699703684388"} 2023-11-11 11:54:44,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 03486b38e1a188d7eb7cb528e5cecc21, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:44,541 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:44,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:44,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 03486b38e1a188d7eb7cb528e5cecc21, disabling compactions & flushes 2023-11-11 11:54:44,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:44,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:44,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. after waiting 0 ms 2023-11-11 11:54:44,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:44,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-11 11:54:44,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:44,549 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:44,549 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 03486b38e1a188d7eb7cb528e5cecc21 to self. 2023-11-11 11:54:44,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:44,551 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=03486b38e1a188d7eb7cb528e5cecc21, regionState=CLOSED 2023-11-11 11:54:44,551 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699703684551"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703684551"}]},"ts":"1699703684551"} 2023-11-11 11:54:44,553 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-11 11:54:44,553 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 03486b38e1a188d7eb7cb528e5cecc21, server=jenkins-hbase4.apache.org,41363,1699703601801 in 162 msec 2023-11-11 11:54:44,553 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=03486b38e1a188d7eb7cb528e5cecc21, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=true 2023-11-11 11:54:44,704 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=03486b38e1a188d7eb7cb528e5cecc21, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:44,704 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699703684704"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703684704"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703684704"}]},"ts":"1699703684704"} 2023-11-11 11:54:44,705 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 03486b38e1a188d7eb7cb528e5cecc21, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:44,856 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:44,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:44,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 03486b38e1a188d7eb7cb528e5cecc21, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:54:44,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:44,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:44,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:44,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:44,861 INFO [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:44,862 DEBUG [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1 2023-11-11 11:54:44,862 DEBUG [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1 2023-11-11 11:54:44,862 INFO [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03486b38e1a188d7eb7cb528e5cecc21 columnFamilyName family1 2023-11-11 11:54:44,867 DEBUG [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/3f6f8006eb4749e5bd2c0f9812ef0de0 2023-11-11 11:54:44,871 DEBUG [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/41a9e7e838e9478f99fd62b07589a974 2023-11-11 11:54:44,874 DEBUG [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8f52770aff884cbdaccfd273cdbf7188_SeqId_46_ 2023-11-11 11:54:44,874 INFO [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] regionserver.HStore(310): Store=03486b38e1a188d7eb7cb528e5cecc21/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:44,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:44,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:44,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:44,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 03486b38e1a188d7eb7cb528e5cecc21; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75381605, jitterRate=0.12327344715595245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:54:44,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:44,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21., pid=63, masterSystemTime=1699703684856 2023-11-11 11:54:44,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:44,880 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-11 11:54:44,882 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-11 11:54:44,882 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1912): 03486b38e1a188d7eb7cb528e5cecc21/family1 is initiating minor compaction (all files) 2023-11-11 11:54:44,882 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 03486b38e1a188d7eb7cb528e5cecc21/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:44,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:44,882 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/41a9e7e838e9478f99fd62b07589a974, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/3f6f8006eb4749e5bd2c0f9812ef0de0, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8f52770aff884cbdaccfd273cdbf7188_SeqId_46_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp, totalSize=388.1 K 2023-11-11 11:54:44,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:44,882 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=03486b38e1a188d7eb7cb528e5cecc21, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:44,882 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 41a9e7e838e9478f99fd62b07589a974, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824916 2023-11-11 11:54:44,882 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699703684882"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703684882"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703684882"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703684882"}]},"ts":"1699703684882"} 2023-11-11 11:54:44,883 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 3f6f8006eb4749e5bd2c0f9812ef0de0, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224916 2023-11-11 11:54:44,883 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 8f52770aff884cbdaccfd273cdbf7188_SeqId_46_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878824916 2023-11-11 11:54:44,883 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41929] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=OPEN, location=jenkins-hbase4.apache.org,41363,1699703601801, table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=03486b38e1a188d7eb7cb528e5cecc21. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-11-11 11:54:44,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-11 11:54:44,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 03486b38e1a188d7eb7cb528e5cecc21, server=jenkins-hbase4.apache.org,41363,1699703601801 in 179 msec 2023-11-11 11:54:44,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-11 11:54:44,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=03486b38e1a188d7eb7cb528e5cecc21, REOPEN/MOVE in 498 msec 2023-11-11 11:54:44,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-11 11:54:44,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 502 msec 2023-11-11 11:54:44,890 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 916 msec 2023-11-11 11:54:44,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-11 11:54:44,892 INFO [Listener at localhost/39241] compactions.TestMobCompactor(278): alter status finished 2023-11-11 11:54:44,893 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:44,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 11:54:44,895 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 11:54:44,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:44,895 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704284895 2023-11-11 11:54:44,898 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): 03486b38e1a188d7eb7cb528e5cecc21#family1#compaction#73 average throughput is 22.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-11 11:54:44,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 11:54:44,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-11 11:54:44,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 11:54:44,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x625029db to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:54:44,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c45ac3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:54:44,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:44,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:44,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:44,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:44,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:45,730 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/.tmp/family1/3ee1e5ad00f84b93aaaf1e48644b394c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/3ee1e5ad00f84b93aaaf1e48644b394c 2023-11-11 11:54:45,734 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 03486b38e1a188d7eb7cb528e5cecc21/family1 of 03486b38e1a188d7eb7cb528e5cecc21 into 3ee1e5ad00f84b93aaaf1e48644b394c(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:54:45,734 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:45,734 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21., storeName=03486b38e1a188d7eb7cb528e5cecc21/family1, priority=13, startTime=1699703684879; duration=0sec 2023-11-11 11:54:45,734 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:45,743 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282beb969500cc4a10ba2198c72e2d3140 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511282beb969500cc4a10ba2198c72e2d3140 2023-11-11 11:54:45,743 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 11:54:45,756 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:54:45,757 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:54:45,763 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:54:45,765 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:54:45,772 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/654a8ad89318478e9340227820ba8167 first=Optional[r05] last=Optional[r8] 2023-11-11 11:54:45,772 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=50 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/654a8ad89318478e9340227820ba8167}] 2023-11-11 11:54:45,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/654a8ad89318478e9340227820ba8167 for inclusion in 03486b38e1a188d7eb7cb528e5cecc21/family1 2023-11-11 11:54:45,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-11 11:54:45,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:54:45,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:45,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/654a8ad89318478e9340227820ba8167 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m57am3tqv7mge17vrad5h3n4bsscj3em3r9p8tq72cdoc775oifs31gbnso6h3pd/family1/654a8ad89318478e9340227820ba8167 2023-11-11 11:54:45,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m57am3tqv7mge17vrad5h3n4bsscj3em3r9p8tq72cdoc775oifs31gbnso6h3pd/family1/654a8ad89318478e9340227820ba8167 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/cee08f5e550149ceb6036164d9b52670_SeqId_53_ 2023-11-11 11:54:45,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m57am3tqv7mge17vrad5h3n4bsscj3em3r9p8tq72cdoc775oifs31gbnso6h3pd/family1/654a8ad89318478e9340227820ba8167 into 03486b38e1a188d7eb7cb528e5cecc21/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/cee08f5e550149ceb6036164d9b52670_SeqId_53_ - updating store file list. 2023-11-11 11:54:45,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/cee08f5e550149ceb6036164d9b52670_SeqId_53_ into 03486b38e1a188d7eb7cb528e5cecc21/family1 2023-11-11 11:54:45,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m57am3tqv7mge17vrad5h3n4bsscj3em3r9p8tq72cdoc775oifs31gbnso6h3pd/family1/654a8ad89318478e9340227820ba8167 into 03486b38e1a188d7eb7cb528e5cecc21/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/cee08f5e550149ceb6036164d9b52670_SeqId_53_) 2023-11-11 11:54:45,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m57am3tqv7mge17vrad5h3n4bsscj3em3r9p8tq72cdoc775oifs31gbnso6h3pd/family1/654a8ad89318478e9340227820ba8167 2023-11-11 11:54:45,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 11:54:45,787 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:45,789 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511209baa0cd5d7a948ecb965c1862c3cd282 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511209baa0cd5d7a948ecb965c1862c3cd282 2023-11-11 11:54:45,790 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128530c7943848c45ecaed58cd6ed41b5a0 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128530c7943848c45ecaed58cd6ed41b5a0 2023-11-11 11:54:45,790 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-11 11:54:45,790 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-11 11:54:45,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:45,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:45,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:45,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 11:54:45,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:45,791 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 11:54:45,792 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 897 msec 2023-11-11 11:54:45,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/41a9e7e838e9478f99fd62b07589a974, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/3f6f8006eb4749e5bd2c0f9812ef0de0, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8f52770aff884cbdaccfd273cdbf7188_SeqId_46_] to archive 2023-11-11 11:54:45,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:45,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/41a9e7e838e9478f99fd62b07589a974 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/41a9e7e838e9478f99fd62b07589a974 2023-11-11 11:54:45,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/3f6f8006eb4749e5bd2c0f9812ef0de0 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/3f6f8006eb4749e5bd2c0f9812ef0de0 2023-11-11 11:54:45,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8f52770aff884cbdaccfd273cdbf7188_SeqId_46_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/8f52770aff884cbdaccfd273cdbf7188_SeqId_46_ 2023-11-11 11:54:45,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-11 11:54:45,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:46,263 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-11 11:54:46,264 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-11 11:54:46,264 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-11 11:54:46,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-11 11:54:46,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=03486b38e1a188d7eb7cb528e5cecc21, REOPEN/MOVE}] 2023-11-11 11:54:46,268 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=03486b38e1a188d7eb7cb528e5cecc21, REOPEN/MOVE 2023-11-11 11:54:46,268 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=03486b38e1a188d7eb7cb528e5cecc21, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:46,269 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699703686268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703686268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703686268"}]},"ts":"1699703686268"} 2023-11-11 11:54:46,270 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 03486b38e1a188d7eb7cb528e5cecc21, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:46,421 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:46,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:46,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 03486b38e1a188d7eb7cb528e5cecc21, disabling compactions & flushes 2023-11-11 11:54:46,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:46,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:46,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. after waiting 0 ms 2023-11-11 11:54:46,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:46,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-11-11 11:54:46,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:46,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:46,426 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 03486b38e1a188d7eb7cb528e5cecc21 to self. 2023-11-11 11:54:46,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:46,427 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=03486b38e1a188d7eb7cb528e5cecc21, regionState=CLOSED 2023-11-11 11:54:46,428 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699703686427"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703686427"}]},"ts":"1699703686427"} 2023-11-11 11:54:46,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-11 11:54:46,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 03486b38e1a188d7eb7cb528e5cecc21, server=jenkins-hbase4.apache.org,41363,1699703601801 in 159 msec 2023-11-11 11:54:46,430 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=03486b38e1a188d7eb7cb528e5cecc21, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=true 2023-11-11 11:54:46,581 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=03486b38e1a188d7eb7cb528e5cecc21, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:46,581 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699703686580"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703686580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703686580"}]},"ts":"1699703686580"} 2023-11-11 11:54:46,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 03486b38e1a188d7eb7cb528e5cecc21, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:46,733 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:46,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:46,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 03486b38e1a188d7eb7cb528e5cecc21, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:54:46,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:46,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:46,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:46,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:46,737 INFO [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:46,738 DEBUG [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1 2023-11-11 11:54:46,738 DEBUG [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1 2023-11-11 11:54:46,738 INFO [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03486b38e1a188d7eb7cb528e5cecc21 columnFamilyName family1 2023-11-11 11:54:46,743 DEBUG [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/3ee1e5ad00f84b93aaaf1e48644b394c 2023-11-11 11:54:46,746 DEBUG [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/family1/cee08f5e550149ceb6036164d9b52670_SeqId_53_ 2023-11-11 11:54:46,746 INFO [StoreOpener-03486b38e1a188d7eb7cb528e5cecc21-1] regionserver.HStore(310): Store=03486b38e1a188d7eb7cb528e5cecc21/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:46,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:46,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:46,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:54:46,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 03486b38e1a188d7eb7cb528e5cecc21; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64308674, jitterRate=-0.04172608256340027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:54:46,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:54:46,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21., pid=69, masterSystemTime=1699703686733 2023-11-11 11:54:46,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:46,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:54:46,753 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=03486b38e1a188d7eb7cb528e5cecc21, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:46,753 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699703686753"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703686753"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703686753"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703686753"}]},"ts":"1699703686753"} 2023-11-11 11:54:46,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-11 11:54:46,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 03486b38e1a188d7eb7cb528e5cecc21, server=jenkins-hbase4.apache.org,41363,1699703601801 in 172 msec 2023-11-11 11:54:46,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-11 11:54:46,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=03486b38e1a188d7eb7cb528e5cecc21, REOPEN/MOVE in 488 msec 2023-11-11 11:54:46,757 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-11 11:54:46,757 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 491 msec 2023-11-11 11:54:46,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 905 msec 2023-11-11 11:54:46,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-11 11:54:46,760 INFO [Listener at localhost/39241] compactions.TestMobCompactor(278): alter status finished 2023-11-11 11:54:46,761 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-11 11:54:46,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 11:54:46,762 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 11:54:46,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:46,763 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704286763 2023-11-11 11:54:46,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 11:54:46,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-11 11:54:46,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 11:54:46,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x4e10ce92 to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:54:46,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@531e065b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:54:46,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:46,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:46,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:46,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:46,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:46,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:46,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:46,776 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-11 11:54:46,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-11 11:54:46,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:46,776 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-11 11:54:46,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 15 msec 2023-11-11 11:54:46,822 INFO [Listener at localhost/39241] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=238 (was 248), OpenFileDescriptor=634 (was 645), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=134 (was 161), ProcessCount=170 (was 170), AvailableMemoryMB=2094 (was 2141) 2023-11-11 11:54:46,833 INFO [Listener at localhost/39241] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=238, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=134, ProcessCount=170, AvailableMemoryMB=2094 2023-11-11 11:54:46,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-11 11:54:46,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-11 11:54:46,837 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 11:54:46,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-11 11:54:46,838 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 11:54:46,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-11 11:54:46,839 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608 2023-11-11 11:54:46,839 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608 empty. 2023-11-11 11:54:46,840 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608 2023-11-11 11:54:46,840 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-11 11:54:46,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-11 11:54:47,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-11 11:54:47,247 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-11 11:54:47,249 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => d458dfb5571c3f5c3ceed1f6a610c608, NAME => 'testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:54:47,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-11 11:54:47,654 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:47,654 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing d458dfb5571c3f5c3ceed1f6a610c608, disabling compactions & flushes 2023-11-11 11:54:47,654 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. 2023-11-11 11:54:47,654 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. 2023-11-11 11:54:47,654 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. after waiting 0 ms 2023-11-11 11:54:47,655 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. 2023-11-11 11:54:47,655 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. 2023-11-11 11:54:47,655 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for d458dfb5571c3f5c3ceed1f6a610c608: 2023-11-11 11:54:47,657 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 11:54:47,658 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699703687657"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703687657"}]},"ts":"1699703687657"} 2023-11-11 11:54:47,659 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 11:54:47,659 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 11:54:47,659 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703687659"}]},"ts":"1699703687659"} 2023-11-11 11:54:47,660 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-11 11:54:47,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d458dfb5571c3f5c3ceed1f6a610c608, ASSIGN}] 2023-11-11 11:54:47,665 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d458dfb5571c3f5c3ceed1f6a610c608, ASSIGN 2023-11-11 11:54:47,666 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=d458dfb5571c3f5c3ceed1f6a610c608, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:54:47,817 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d458dfb5571c3f5c3ceed1f6a610c608, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:47,817 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699703687817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703687817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703687817"}]},"ts":"1699703687817"} 2023-11-11 11:54:47,818 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure d458dfb5571c3f5c3ceed1f6a610c608, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:47,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-11 11:54:47,969 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:47,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. 2023-11-11 11:54:47,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d458dfb5571c3f5c3ceed1f6a610c608, NAME => 'testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:54:47,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-11 11:54:47,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-11 11:54:47,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction d458dfb5571c3f5c3ceed1f6a610c608 2023-11-11 11:54:47,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:47,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d458dfb5571c3f5c3ceed1f6a610c608 2023-11-11 11:54:47,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d458dfb5571c3f5c3ceed1f6a610c608 2023-11-11 11:54:47,975 INFO [StoreOpener-d458dfb5571c3f5c3ceed1f6a610c608-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d458dfb5571c3f5c3ceed1f6a610c608 2023-11-11 11:54:47,977 DEBUG [StoreOpener-d458dfb5571c3f5c3ceed1f6a610c608-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1 2023-11-11 11:54:47,977 DEBUG [StoreOpener-d458dfb5571c3f5c3ceed1f6a610c608-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1 2023-11-11 11:54:47,977 INFO [StoreOpener-d458dfb5571c3f5c3ceed1f6a610c608-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d458dfb5571c3f5c3ceed1f6a610c608 columnFamilyName f1 2023-11-11 11:54:47,978 INFO [StoreOpener-d458dfb5571c3f5c3ceed1f6a610c608-1] regionserver.HStore(310): Store=d458dfb5571c3f5c3ceed1f6a610c608/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:47,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608 2023-11-11 11:54:47,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608 2023-11-11 11:54:47,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d458dfb5571c3f5c3ceed1f6a610c608 2023-11-11 11:54:47,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:54:47,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d458dfb5571c3f5c3ceed1f6a610c608; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69701419, jitterRate=0.03863207995891571}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:54:47,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d458dfb5571c3f5c3ceed1f6a610c608: 2023-11-11 11:54:47,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608., pid=73, masterSystemTime=1699703687969 2023-11-11 11:54:47,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. 2023-11-11 11:54:47,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. 2023-11-11 11:54:47,985 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d458dfb5571c3f5c3ceed1f6a610c608, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:47,985 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699703687985"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703687985"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703687985"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703687985"}]},"ts":"1699703687985"} 2023-11-11 11:54:47,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-11 11:54:47,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure d458dfb5571c3f5c3ceed1f6a610c608, server=jenkins-hbase4.apache.org,41363,1699703601801 in 168 msec 2023-11-11 11:54:47,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-11 11:54:47,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=d458dfb5571c3f5c3ceed1f6a610c608, ASSIGN in 324 msec 2023-11-11 11:54:47,989 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 11:54:47,989 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703687989"}]},"ts":"1699703687989"} 2023-11-11 11:54:47,990 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-11 11:54:47,992 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 11:54:47,993 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1560 sec 2023-11-11 11:54:48,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-11 11:54:48,943 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-11 11:54:48,943 DEBUG [Listener at localhost/39241] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-11 11:54:48,944 INFO [Listener at localhost/39241] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-11 11:54:48,947 INFO [Listener at localhost/39241] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-11 11:54:48,948 INFO [Listener at localhost/39241] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-11 11:54:48,948 INFO [Listener at localhost/39241] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-11 11:54:48,951 INFO [Listener at localhost/39241] regionserver.HRegion(2745): Flushing d458dfb5571c3f5c3ceed1f6a610c608 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-11 11:54:49,363 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111fb844c30eeeb465e9d4943abf8ef7847 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231111fb844c30eeeb465e9d4943abf8ef7847 2023-11-11 11:54:49,768 INFO [Listener at localhost/39241] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/.tmp/f1/f09e1a489f5e461e89f6e4bdda0ba507 2023-11-11 11:54:49,773 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/.tmp/f1/f09e1a489f5e461e89f6e4bdda0ba507 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507 2023-11-11 11:54:49,777 INFO [Listener at localhost/39241] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507, entries=1, sequenceid=5, filesize=4.9 K 2023-11-11 11:54:49,778 INFO [Listener at localhost/39241] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for d458dfb5571c3f5c3ceed1f6a610c608 in 827ms, sequenceid=5, compaction requested=false 2023-11-11 11:54:49,778 DEBUG [Listener at localhost/39241] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-11 11:54:49,778 DEBUG [Listener at localhost/39241] regionserver.HRegion(2446): Flush status journal for d458dfb5571c3f5c3ceed1f6a610c608: 2023-11-11 11:54:49,780 INFO [Listener at localhost/39241] regionserver.HRegion(2745): Flushing d458dfb5571c3f5c3ceed1f6a610c608 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-11 11:54:50,082 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 11:54:50,192 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111dc05aa4fe34d4cc5a4a41c94d7d70b1b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231111dc05aa4fe34d4cc5a4a41c94d7d70b1b 2023-11-11 11:54:50,597 INFO [Listener at localhost/39241] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/.tmp/f1/c67f9e9b7e064a9c9b5ebb4cd7762612 2023-11-11 11:54:50,601 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/.tmp/f1/c67f9e9b7e064a9c9b5ebb4cd7762612 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612 2023-11-11 11:54:50,605 INFO [Listener at localhost/39241] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612, entries=1, sequenceid=9, filesize=4.9 K 2023-11-11 11:54:50,606 INFO [Listener at localhost/39241] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for d458dfb5571c3f5c3ceed1f6a610c608 in 826ms, sequenceid=9, compaction requested=false 2023-11-11 11:54:50,606 DEBUG [Listener at localhost/39241] regionserver.HRegion(2446): Flush status journal for d458dfb5571c3f5c3ceed1f6a610c608: 2023-11-11 11:54:50,607 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-11 11:54:50,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-11 11:54:50,609 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-11 11:54:50,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:50,609 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704290609 2023-11-11 11:54:50,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-11 11:54:50,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-11 11:54:50,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-11 11:54:50,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x30a017d5 to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:54:50,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@132fe344, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:54:50,615 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231111 for table='testGetAfterCompaction' and column='f1' 2023-11-11 11:54:50,658 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:50,658 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:50,709 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:50,709 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:50,757 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-11 11:54:50,757 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-11-11 11:54:50,760 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:50,760 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:50,810 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:50,810 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:50,861 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:50,861 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:50,912 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:50,912 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:50,963 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:50,963 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,013 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,013 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,064 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,064 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,115 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,115 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,165 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,165 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,216 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,216 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,267 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,267 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,317 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,317 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,368 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,368 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,418 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,418 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,437 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111174c177596ad64886896b2cebd1048b92 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023111174c177596ad64886896b2cebd1048b92 2023-11-11 11:54:51,438 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testGetAfterCompaction' column='f1' 2023-11-11 11:54:51,457 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:54:51,458 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:54:51,463 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:54:51,465 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:54:51,469 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,469 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,473 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/f1/713fb5b6829c42e3bbde0d0ff73f87aa first=Optional[r1] last=Optional[r2] 2023-11-11 11:54:51,474 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{f1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/f1/713fb5b6829c42e3bbde0d0ff73f87aa}] 2023-11-11 11:54:51,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/f1/713fb5b6829c42e3bbde0d0ff73f87aa for inclusion in d458dfb5571c3f5c3ceed1f6a610c608/f1 2023-11-11 11:54:51,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-11 11:54:51,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:54:51,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for d458dfb5571c3f5c3ceed1f6a610c608: 2023-11-11 11:54:51,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/f1/713fb5b6829c42e3bbde0d0ff73f87aa to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testGetAfterCompaction__9snd6hseknfup2pgoelvapitvioehpjoa1lts18vfifhfua9mj9s1fmoe66lmsul/f1/713fb5b6829c42e3bbde0d0ff73f87aa 2023-11-11 11:54:51,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testGetAfterCompaction__9snd6hseknfup2pgoelvapitvioehpjoa1lts18vfifhfua9mj9s1fmoe66lmsul/f1/713fb5b6829c42e3bbde0d0ff73f87aa as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_ 2023-11-11 11:54:51,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testGetAfterCompaction__9snd6hseknfup2pgoelvapitvioehpjoa1lts18vfifhfua9mj9s1fmoe66lmsul/f1/713fb5b6829c42e3bbde0d0ff73f87aa into d458dfb5571c3f5c3ceed1f6a610c608/f1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_ - updating store file list. 2023-11-11 11:54:51,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_ into d458dfb5571c3f5c3ceed1f6a610c608/f1 2023-11-11 11:54:51,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testGetAfterCompaction__9snd6hseknfup2pgoelvapitvioehpjoa1lts18vfifhfua9mj9s1fmoe66lmsul/f1/713fb5b6829c42e3bbde0d0ff73f87aa into d458dfb5571c3f5c3ceed1f6a610c608/f1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_) 2023-11-11 11:54:51,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testGetAfterCompaction__9snd6hseknfup2pgoelvapitvioehpjoa1lts18vfifhfua9mj9s1fmoe66lmsul/f1/713fb5b6829c42e3bbde0d0ff73f87aa 2023-11-11 11:54:51,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(1912): d458dfb5571c3f5c3ceed1f6a610c608/f1 is initiating minor compaction 2023-11-11 11:54:51,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7a018d16; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:51,486 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d458dfb5571c3f5c3ceed1f6a610c608/f1 in testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. 2023-11-11 11:54:51,486 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/.tmp, totalSize=10.0 K 2023-11-11 11:54:51,486 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting c67f9e9b7e064a9c9b5ebb4cd7762612, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 11:54:51,486 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 1319331e818b485d9a873094a2d7e186_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 11:54:51,487 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testGetAfterCompaction' column='f1' 2023-11-11 11:54:51,488 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:51,490 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231111dc05aa4fe34d4cc5a4a41c94d7d70b1b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231111dc05aa4fe34d4cc5a4a41c94d7d70b1b 2023-11-11 11:54:51,491 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231111fb844c30eeeb465e9d4943abf8ef7847 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231111fb844c30eeeb465e9d4943abf8ef7847 2023-11-11 11:54:51,491 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-11 11:54:51,491 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231111' 2023-11-11 11:54:51,491 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231111 for table='testGetAfterCompaction' and column='f1' 2023-11-11 11:54:51,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-11 11:54:51,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:54:51,492 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-11 11:54:51,493 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): d458dfb5571c3f5c3ceed1f6a610c608#f1#compaction#76 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-11 11:54:51,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 885 msec 2023-11-11 11:54:51,520 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:51,520 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,520 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,523 DEBUG [Listener at localhost/39241] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-11 11:54:51,664 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:54:51,664 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-11 11:54:51,664 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-11 11:54:51,664 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30a017d5 to 127.0.0.1:59344 2023-11-11 11:54:51,664 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:54:51,664 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41363] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. 2023-11-11 11:54:51,664 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:54:51,665 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x625029db to 127.0.0.1:59344 2023-11-11 11:54:51,665 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:54:51,665 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e10ce92 to 127.0.0.1:59344 2023-11-11 11:54:51,665 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:54:51,665 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-11 11:54:51,665 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-11 11:54:51,665 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41363] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-11 11:54:51,665 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41363] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. because compaction request was cancelled 2023-11-11 11:54:51,718 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:51,718 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,718 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,769 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:51,769 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,769 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,820 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:51,820 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,820 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,870 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:51,870 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,870 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,921 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:51,921 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,921 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,972 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:51,972 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:51,972 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,022 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:52,022 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,022 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,073 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:52,073 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,073 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,124 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:52,124 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,124 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,174 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:52,174 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,174 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,225 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:52,225 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,225 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,276 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:52,276 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,276 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,307 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/.tmp/f1/e9c00fad4d014391afb0bda5bcc312ca as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/e9c00fad4d014391afb0bda5bcc312ca 2023-11-11 11:54:52,311 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in d458dfb5571c3f5c3ceed1f6a610c608/f1 of d458dfb5571c3f5c3ceed1f6a610c608 into e9c00fad4d014391afb0bda5bcc312ca(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:54:52,311 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d458dfb5571c3f5c3ceed1f6a610c608: 2023-11-11 11:54:52,311 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1699703691485; duration=0sec 2023-11-11 11:54:52,311 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:54:52,326 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699703691433; access_time=1699703690625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-11 11:54:52,326 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703690596; access_time=1699703689782; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,326 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/e9c00fad4d014391afb0bda5bcc312ca; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699703692302; access_time=1699703691491; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,326 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_] to archive 2023-11-11 11:54:52,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:54:52,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/c67f9e9b7e064a9c9b5ebb4cd7762612 2023-11-11 11:54:52,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/1319331e818b485d9a873094a2d7e186_SeqId_12_ 2023-11-11 11:54:52,377 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/e9c00fad4d014391afb0bda5bcc312ca; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699703692302; access_time=1699703691491; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,377 INFO [Listener at localhost/39241] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699703689768; access_time=1699703688954; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-11 11:54:52,495 INFO [Listener at localhost/39241] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-11 11:54:52,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-11 11:54:52,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-11 11:54:52,511 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703692511"}]},"ts":"1699703692511"} 2023-11-11 11:54:52,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-11 11:54:52,513 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-11 11:54:52,515 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-11 11:54:52,516 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d458dfb5571c3f5c3ceed1f6a610c608, UNASSIGN}] 2023-11-11 11:54:52,518 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d458dfb5571c3f5c3ceed1f6a610c608, UNASSIGN 2023-11-11 11:54:52,518 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d458dfb5571c3f5c3ceed1f6a610c608, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:52,519 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699703692518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703692518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703692518"}]},"ts":"1699703692518"} 2023-11-11 11:54:52,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure d458dfb5571c3f5c3ceed1f6a610c608, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:52,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-11 11:54:52,671 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:52,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d458dfb5571c3f5c3ceed1f6a610c608 2023-11-11 11:54:52,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d458dfb5571c3f5c3ceed1f6a610c608, disabling compactions & flushes 2023-11-11 11:54:52,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. 2023-11-11 11:54:52,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. 2023-11-11 11:54:52,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. after waiting 0 ms 2023-11-11 11:54:52,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. 2023-11-11 11:54:52,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-11 11:54:52,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-11 11:54:52,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608. 2023-11-11 11:54:52,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d458dfb5571c3f5c3ceed1f6a610c608: 2023-11-11 11:54:52,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d458dfb5571c3f5c3ceed1f6a610c608 2023-11-11 11:54:52,680 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d458dfb5571c3f5c3ceed1f6a610c608, regionState=CLOSED 2023-11-11 11:54:52,681 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699703692680"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703692680"}]},"ts":"1699703692680"} 2023-11-11 11:54:52,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-11 11:54:52,683 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure d458dfb5571c3f5c3ceed1f6a610c608, server=jenkins-hbase4.apache.org,41363,1699703601801 in 162 msec 2023-11-11 11:54:52,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-11 11:54:52,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=d458dfb5571c3f5c3ceed1f6a610c608, UNASSIGN in 167 msec 2023-11-11 11:54:52,685 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703692685"}]},"ts":"1699703692685"} 2023-11-11 11:54:52,686 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-11 11:54:52,688 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-11 11:54:52,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 186 msec 2023-11-11 11:54:52,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-11 11:54:52,815 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-11 11:54:52,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-11 11:54:52,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-11 11:54:52,826 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-11 11:54:52,827 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-11 11:54:52,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-11 11:54:52,830 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608 2023-11-11 11:54:52,832 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1, FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/recovered.edits] 2023-11-11 11:54:52,835 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/e9c00fad4d014391afb0bda5bcc312ca to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/e9c00fad4d014391afb0bda5bcc312ca 2023-11-11 11:54:52,836 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/f1/f09e1a489f5e461e89f6e4bdda0ba507 2023-11-11 11:54:52,838 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/recovered.edits/15.seqid to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608/recovered.edits/15.seqid 2023-11-11 11:54:52,839 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testGetAfterCompaction/d458dfb5571c3f5c3ceed1f6a610c608 2023-11-11 11:54:52,839 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-11 11:54:52,839 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-11 11:54:52,840 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-11 11:54:52,843 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023111174c177596ad64886896b2cebd1048b92 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023111174c177596ad64886896b2cebd1048b92 2023-11-11 11:54:52,844 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-11 11:54:52,845 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-11 11:54:52,866 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-11 11:54:52,868 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-11 11:54:52,869 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-11 11:54:52,869 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-11 11:54:52,870 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699703692869"}]},"ts":"9223372036854775807"} 2023-11-11 11:54:52,871 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-11 11:54:52,871 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d458dfb5571c3f5c3ceed1f6a610c608, NAME => 'testGetAfterCompaction,,1699703686835.d458dfb5571c3f5c3ceed1f6a610c608.', STARTKEY => '', ENDKEY => ''}] 2023-11-11 11:54:52,871 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-11 11:54:52,871 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1699703692871"}]},"ts":"9223372036854775807"} 2023-11-11 11:54:52,872 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-11 11:54:52,874 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-11 11:54:52,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 54 msec 2023-11-11 11:54:52,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-11 11:54:52,929 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-11 11:54:52,943 INFO [Listener at localhost/39241] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=233 (was 238), OpenFileDescriptor=618 (was 634), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=123 (was 134), ProcessCount=170 (was 170), AvailableMemoryMB=2045 (was 2094) 2023-11-11 11:54:52,954 INFO [Listener at localhost/39241] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=233, OpenFileDescriptor=618, MaxFileDescriptor=60000, SystemLoadAverage=123, ProcessCount=170, AvailableMemoryMB=2045 2023-11-11 11:54:52,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-11 11:54:52,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-11 11:54:52,957 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 11:54:52,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-11 11:54:52,958 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 11:54:52,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-11 11:54:52,960 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:54:52,960 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b 2023-11-11 11:54:52,960 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34 2023-11-11 11:54:52,960 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e empty. 2023-11-11 11:54:52,960 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b empty. 2023-11-11 11:54:52,961 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34 empty. 2023-11-11 11:54:52,961 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:54:52,961 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b 2023-11-11 11:54:52,961 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34 2023-11-11 11:54:52,961 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-11 11:54:53,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-11 11:54:53,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-11 11:54:53,375 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-11 11:54:53,377 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 99dc75f3ad72a9db7000d7e9e3c61b9e, NAME => 'testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:54:53,377 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => be5c328b64d96b557d201a387d04fa34, NAME => 'testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:54:53,377 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 998271c54a88643806fe1b6c1978d34b, NAME => 'testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:54:53,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-11 11:54:53,800 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:53,800 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 99dc75f3ad72a9db7000d7e9e3c61b9e, disabling compactions & flushes 2023-11-11 11:54:53,800 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:54:53,800 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:54:53,800 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. after waiting 0 ms 2023-11-11 11:54:53,800 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:54:53,800 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:54:53,800 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:54:53,803 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:53,803 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing be5c328b64d96b557d201a387d04fa34, disabling compactions & flushes 2023-11-11 11:54:53,803 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:54:53,803 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:54:53,803 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. after waiting 0 ms 2023-11-11 11:54:53,803 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:54:53,803 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:54:53,803 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:54:53,803 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:53,803 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 998271c54a88643806fe1b6c1978d34b, disabling compactions & flushes 2023-11-11 11:54:53,803 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:54:53,803 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:54:53,803 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. after waiting 0 ms 2023-11-11 11:54:53,803 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:54:53,803 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:54:53,803 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:54:53,805 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 11:54:53,806 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703693806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703693806"}]},"ts":"1699703693806"} 2023-11-11 11:54:53,806 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703693806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703693806"}]},"ts":"1699703693806"} 2023-11-11 11:54:53,806 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703693806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703693806"}]},"ts":"1699703693806"} 2023-11-11 11:54:53,808 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-11 11:54:53,808 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 11:54:53,808 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703693808"}]},"ts":"1699703693808"} 2023-11-11 11:54:53,809 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-11 11:54:53,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=99dc75f3ad72a9db7000d7e9e3c61b9e, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=998271c54a88643806fe1b6c1978d34b, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=be5c328b64d96b557d201a387d04fa34, ASSIGN}] 2023-11-11 11:54:53,816 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=99dc75f3ad72a9db7000d7e9e3c61b9e, ASSIGN 2023-11-11 11:54:53,816 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=be5c328b64d96b557d201a387d04fa34, ASSIGN 2023-11-11 11:54:53,816 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=998271c54a88643806fe1b6c1978d34b, ASSIGN 2023-11-11 11:54:53,816 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=99dc75f3ad72a9db7000d7e9e3c61b9e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:54:53,816 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=be5c328b64d96b557d201a387d04fa34, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:54:53,816 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=998271c54a88643806fe1b6c1978d34b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:54:53,968 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=be5c328b64d96b557d201a387d04fa34, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:53,968 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=99dc75f3ad72a9db7000d7e9e3c61b9e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:53,968 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703693968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703693968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703693968"}]},"ts":"1699703693968"} 2023-11-11 11:54:53,968 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=998271c54a88643806fe1b6c1978d34b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:53,968 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703693968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703693968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703693968"}]},"ts":"1699703693968"} 2023-11-11 11:54:53,968 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703693968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703693968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703693968"}]},"ts":"1699703693968"} 2023-11-11 11:54:53,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure be5c328b64d96b557d201a387d04fa34, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:53,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure 99dc75f3ad72a9db7000d7e9e3c61b9e, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:53,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure 998271c54a88643806fe1b6c1978d34b, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:54:54,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-11 11:54:54,122 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:54,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:54:54,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be5c328b64d96b557d201a387d04fa34, NAME => 'testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.', STARTKEY => '2', ENDKEY => ''} 2023-11-11 11:54:54,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink be5c328b64d96b557d201a387d04fa34 2023-11-11 11:54:54,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:54,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for be5c328b64d96b557d201a387d04fa34 2023-11-11 11:54:54,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for be5c328b64d96b557d201a387d04fa34 2023-11-11 11:54:54,126 INFO [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region be5c328b64d96b557d201a387d04fa34 2023-11-11 11:54:54,127 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1 2023-11-11 11:54:54,127 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1 2023-11-11 11:54:54,128 INFO [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be5c328b64d96b557d201a387d04fa34 columnFamilyName family1 2023-11-11 11:54:54,129 INFO [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(310): Store=be5c328b64d96b557d201a387d04fa34/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:54,129 INFO [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region be5c328b64d96b557d201a387d04fa34 2023-11-11 11:54:54,130 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2 2023-11-11 11:54:54,130 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2 2023-11-11 11:54:54,130 INFO [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be5c328b64d96b557d201a387d04fa34 columnFamilyName family2 2023-11-11 11:54:54,131 INFO [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(310): Store=be5c328b64d96b557d201a387d04fa34/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:54,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34 2023-11-11 11:54:54,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34 2023-11-11 11:54:54,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:54:54,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for be5c328b64d96b557d201a387d04fa34 2023-11-11 11:54:54,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:54:54,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened be5c328b64d96b557d201a387d04fa34; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68030123, jitterRate=0.013727828860282898}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:54:54,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:54:54,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34., pid=83, masterSystemTime=1699703694122 2023-11-11 11:54:54,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:54:54,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:54:54,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:54:54,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 99dc75f3ad72a9db7000d7e9e3c61b9e, NAME => 'testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.', STARTKEY => '', ENDKEY => '1'} 2023-11-11 11:54:54,140 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=be5c328b64d96b557d201a387d04fa34, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:54,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:54:54,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:54,140 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703694140"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703694140"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703694140"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703694140"}]},"ts":"1699703694140"} 2023-11-11 11:54:54,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:54:54,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:54:54,142 INFO [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:54:54,143 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1 2023-11-11 11:54:54,143 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1 2023-11-11 11:54:54,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=82 2023-11-11 11:54:54,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure be5c328b64d96b557d201a387d04fa34, server=jenkins-hbase4.apache.org,41363,1699703601801 in 173 msec 2023-11-11 11:54:54,143 INFO [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99dc75f3ad72a9db7000d7e9e3c61b9e columnFamilyName family1 2023-11-11 11:54:54,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=be5c328b64d96b557d201a387d04fa34, ASSIGN in 328 msec 2023-11-11 11:54:54,144 INFO [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(310): Store=99dc75f3ad72a9db7000d7e9e3c61b9e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:54,145 INFO [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:54:54,146 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2 2023-11-11 11:54:54,146 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2 2023-11-11 11:54:54,146 INFO [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99dc75f3ad72a9db7000d7e9e3c61b9e columnFamilyName family2 2023-11-11 11:54:54,147 INFO [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(310): Store=99dc75f3ad72a9db7000d7e9e3c61b9e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:54,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:54:54,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:54:54,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:54:54,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:54:54,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:54:54,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 99dc75f3ad72a9db7000d7e9e3c61b9e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73224035, jitterRate=0.09112314879894257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:54:54,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:54:54,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e., pid=84, masterSystemTime=1699703694122 2023-11-11 11:54:54,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:54:54,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:54:54,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:54:54,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 998271c54a88643806fe1b6c1978d34b, NAME => 'testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.', STARTKEY => '1', ENDKEY => '2'} 2023-11-11 11:54:54,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:54:54,155 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=99dc75f3ad72a9db7000d7e9e3c61b9e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:54,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:54:54,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:54:54,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:54:54,155 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703694155"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703694155"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703694155"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703694155"}]},"ts":"1699703694155"} 2023-11-11 11:54:54,156 INFO [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:54:54,157 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1 2023-11-11 11:54:54,157 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1 2023-11-11 11:54:54,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=80 2023-11-11 11:54:54,157 INFO [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 998271c54a88643806fe1b6c1978d34b columnFamilyName family1 2023-11-11 11:54:54,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure 99dc75f3ad72a9db7000d7e9e3c61b9e, server=jenkins-hbase4.apache.org,41363,1699703601801 in 186 msec 2023-11-11 11:54:54,158 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=99dc75f3ad72a9db7000d7e9e3c61b9e, ASSIGN in 344 msec 2023-11-11 11:54:54,158 INFO [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(310): Store=998271c54a88643806fe1b6c1978d34b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:54,159 INFO [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:54:54,160 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2 2023-11-11 11:54:54,160 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2 2023-11-11 11:54:54,160 INFO [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 998271c54a88643806fe1b6c1978d34b columnFamilyName family2 2023-11-11 11:54:54,161 INFO [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(310): Store=998271c54a88643806fe1b6c1978d34b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:54:54,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b 2023-11-11 11:54:54,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b 2023-11-11 11:54:54,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:54:54,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:54:54,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:54:54,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 998271c54a88643806fe1b6c1978d34b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60000069, jitterRate=-0.10592930018901825}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:54:54,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:54:54,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b., pid=85, masterSystemTime=1699703694122 2023-11-11 11:54:54,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:54:54,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:54:54,168 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=998271c54a88643806fe1b6c1978d34b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:54,168 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703694168"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703694168"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703694168"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703694168"}]},"ts":"1699703694168"} 2023-11-11 11:54:54,170 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=81 2023-11-11 11:54:54,170 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure 998271c54a88643806fe1b6c1978d34b, server=jenkins-hbase4.apache.org,41363,1699703601801 in 199 msec 2023-11-11 11:54:54,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=79 2023-11-11 11:54:54,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=998271c54a88643806fe1b6c1978d34b, ASSIGN in 357 msec 2023-11-11 11:54:54,172 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 11:54:54,172 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703694172"}]},"ts":"1699703694172"} 2023-11-11 11:54:54,173 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-11 11:54:54,174 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 11:54:54,175 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2190 sec 2023-11-11 11:54:55,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-11 11:54:55,063 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-11 11:54:55,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:54:55,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:54:55,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:54:55,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:55,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-11 11:54:55,077 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-11 11:54:55,077 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:55,077 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-11 11:54:55,077 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-11 11:54:55,077 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:55,077 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:55,078 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:55,078 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:55,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:55,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:55,079 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:55,079 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:55,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:55,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:55,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:55,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:55,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-11 11:54:55,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-11 11:54:55,080 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-11 11:54:55,080 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:55,080 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-11 11:54:55,080 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:54:55,080 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:54:55,080 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:54:55,080 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:55,080 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. started... 2023-11-11 11:54:55,080 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. started... 2023-11-11 11:54:55,080 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:54:55,081 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 998271c54a88643806fe1b6c1978d34b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 11:54:55,081 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 99dc75f3ad72a9db7000d7e9e3c61b9e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 11:54:55,081 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. started... 2023-11-11 11:54:55,082 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing be5c328b64d96b557d201a387d04fa34 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 11:54:55,497 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111268f2ac8d9e44280bb779f3386228ee7 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111268f2ac8d9e44280bb779f3386228ee7 2023-11-11 11:54:55,497 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311114bc9a91b07384b3e8fda78dd5d92b84f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311114bc9a91b07384b3e8fda78dd5d92b84f 2023-11-11 11:54:55,497 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111dbbb4786da604d108b924c71130c6610 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111dbbb4786da604d108b924c71130c6610 2023-11-11 11:54:55,905 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family1/6da56152861b4113921b3ffe3773b558 2023-11-11 11:54:55,905 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family1/3738921820ab429a8b72082afee389a5 2023-11-11 11:54:55,905 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family1/bd9a2401a2a04526ab71e7964c181ab8 2023-11-11 11:54:56,321 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111b06f1067a20242beba4ae0c7e2747a4d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111b06f1067a20242beba4ae0c7e2747a4d 2023-11-11 11:54:56,321 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111c8a08260f649405594debdcc95d729cf to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111c8a08260f649405594debdcc95d729cf 2023-11-11 11:54:56,321 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111137e9fe82b284a3ab6803d13e47385cc to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111137e9fe82b284a3ab6803d13e47385cc 2023-11-11 11:54:56,327 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family2/f413166c047243caaea4d6a006096d73 2023-11-11 11:54:56,330 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family1/bd9a2401a2a04526ab71e7964c181ab8 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bd9a2401a2a04526ab71e7964c181ab8 2023-11-11 11:54:56,333 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bd9a2401a2a04526ab71e7964c181ab8, entries=4, sequenceid=5, filesize=5.4 K 2023-11-11 11:54:56,334 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family2/f413166c047243caaea4d6a006096d73 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/f413166c047243caaea4d6a006096d73 2023-11-11 11:54:56,337 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/f413166c047243caaea4d6a006096d73, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 11:54:56,338 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for be5c328b64d96b557d201a387d04fa34 in 1256ms, sequenceid=5, compaction requested=false 2023-11-11 11:54:56,338 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-11 11:54:56,338 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:54:56,338 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:54:56,338 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:54:56,727 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family2/ca6ba7ef50234eea9235094f18b4172b 2023-11-11 11:54:56,727 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family2/d136474a81d94d1e9a20a83d42568946 2023-11-11 11:54:56,732 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family1/6da56152861b4113921b3ffe3773b558 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/6da56152861b4113921b3ffe3773b558 2023-11-11 11:54:56,732 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family1/3738921820ab429a8b72082afee389a5 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/3738921820ab429a8b72082afee389a5 2023-11-11 11:54:56,735 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/6da56152861b4113921b3ffe3773b558, entries=4, sequenceid=5, filesize=5.4 K 2023-11-11 11:54:56,736 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family2/ca6ba7ef50234eea9235094f18b4172b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/ca6ba7ef50234eea9235094f18b4172b 2023-11-11 11:54:56,736 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/3738921820ab429a8b72082afee389a5, entries=4, sequenceid=5, filesize=5.4 K 2023-11-11 11:54:56,737 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family2/d136474a81d94d1e9a20a83d42568946 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/d136474a81d94d1e9a20a83d42568946 2023-11-11 11:54:56,740 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/ca6ba7ef50234eea9235094f18b4172b, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 11:54:56,740 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/d136474a81d94d1e9a20a83d42568946, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 11:54:56,741 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 99dc75f3ad72a9db7000d7e9e3c61b9e in 1660ms, sequenceid=5, compaction requested=false 2023-11-11 11:54:56,741 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 998271c54a88643806fe1b6c1978d34b in 1660ms, sequenceid=5, compaction requested=false 2023-11-11 11:54:56,742 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:54:56,742 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:54:56,742 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:54:56,742 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:54:56,742 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:54:56,742 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:54:56,742 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:54:56,742 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,742 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-11 11:54:56,742 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-11 11:54:56,744 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:56,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:56,745 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:56,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:56,745 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:56,745 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:56,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:56,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:56,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:56,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-11 11:54:56,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fe476d2[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:56,746 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-11 11:54:56,746 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:56,748 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:56,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:56,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:56,748 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-11 11:54:56,748 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-11 11:54:56,748 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:56,748 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,748 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:56,749 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,749 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-11 11:54:56,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:56,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:56,749 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:56,749 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-11 11:54:56,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:56,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:56,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:56,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:56,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:56,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:56,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-11 11:54:56,752 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-11 11:54:56,752 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:56,752 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:56,752 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-11 11:54:56,752 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:56,753 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:56,753 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:56,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:56,753 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:56,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:56,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:56,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:56,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:56,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:56,754 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:56,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:56,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:56,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:56,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:56,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:56,755 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:56,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:56,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:56,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:56,760 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:56,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:56,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:56,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:56,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-11 11:54:56,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:56,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:56,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-11 11:54:56,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:56,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:56,760 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:56,760 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:56,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:56,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:56,760 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:56,860 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:56,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:56,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:54:56,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:54:56,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:54:56,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:56,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:56,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-11 11:54:56,868 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-11 11:54:56,868 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:56,868 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-11 11:54:56,868 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-11 11:54:56,868 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:56,868 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:56,870 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:56,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:56,870 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:56,870 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:56,870 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:56,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:56,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:56,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:56,871 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-11 11:54:56,871 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-11 11:54:56,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-11 11:54:56,872 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-11 11:54:56,872 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:56,872 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-11 11:54:56,872 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:54:56,872 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. started... 2023-11-11 11:54:56,872 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 998271c54a88643806fe1b6c1978d34b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 11:54:56,872 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:54:56,872 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. started... 2023-11-11 11:54:56,872 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 99dc75f3ad72a9db7000d7e9e3c61b9e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 11:54:56,875 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:54:56,875 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:56,875 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:54:56,875 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. started... 2023-11-11 11:54:56,876 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing be5c328b64d96b557d201a387d04fa34 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 11:54:56,918 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111157b7dfde3a9f4e289de14ae640c58280 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111157b7dfde3a9f4e289de14ae640c58280 2023-11-11 11:54:56,922 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family1/825c734d3648470ea46c9a8cd735e032 2023-11-11 11:54:57,309 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311113d083de89f244dc1b8f891700d4b02f1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311113d083de89f244dc1b8f891700d4b02f1 2023-11-11 11:54:57,310 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111d2a9790abffe4d8eb6cec085a7d80c30 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111d2a9790abffe4d8eb6cec085a7d80c30 2023-11-11 11:54:57,314 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family1/146911079b654a03a6e1e419f77709e2 2023-11-11 11:54:57,337 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111186844b5641d841c98eed4a8dcdd93eed to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111186844b5641d841c98eed4a8dcdd93eed 2023-11-11 11:54:57,715 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family1/29873cbdec4f487989fa6b226e794508 2023-11-11 11:54:57,727 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311111c32ac5521894ab98daaed0051f408f6 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311111c32ac5521894ab98daaed0051f408f6 2023-11-11 11:54:57,741 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family2/af9aad0939ef4556ab0757d47af29d98 2023-11-11 11:54:57,745 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family1/825c734d3648470ea46c9a8cd735e032 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/825c734d3648470ea46c9a8cd735e032 2023-11-11 11:54:57,748 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/825c734d3648470ea46c9a8cd735e032, entries=4, sequenceid=9, filesize=5.4 K 2023-11-11 11:54:57,748 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family2/af9aad0939ef4556ab0757d47af29d98 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/af9aad0939ef4556ab0757d47af29d98 2023-11-11 11:54:57,751 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/af9aad0939ef4556ab0757d47af29d98, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 11:54:57,752 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for be5c328b64d96b557d201a387d04fa34 in 877ms, sequenceid=9, compaction requested=false 2023-11-11 11:54:57,752 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:54:57,752 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:54:57,752 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:54:58,134 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family2/aa9650f16fef4fb2a0e814af62aa97d4 2023-11-11 11:54:58,135 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111102f9b3368c3243d386bb3a3f42ab2ab7 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111102f9b3368c3243d386bb3a3f42ab2ab7 2023-11-11 11:54:58,139 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family1/146911079b654a03a6e1e419f77709e2 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/146911079b654a03a6e1e419f77709e2 2023-11-11 11:54:58,141 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family2/d5657159438b4fbca63c754f39f2182c 2023-11-11 11:54:58,142 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/146911079b654a03a6e1e419f77709e2, entries=4, sequenceid=9, filesize=5.4 K 2023-11-11 11:54:58,143 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family2/aa9650f16fef4fb2a0e814af62aa97d4 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/aa9650f16fef4fb2a0e814af62aa97d4 2023-11-11 11:54:58,146 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family1/29873cbdec4f487989fa6b226e794508 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/29873cbdec4f487989fa6b226e794508 2023-11-11 11:54:58,147 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/aa9650f16fef4fb2a0e814af62aa97d4, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 11:54:58,148 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 998271c54a88643806fe1b6c1978d34b in 1276ms, sequenceid=9, compaction requested=false 2023-11-11 11:54:58,148 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:54:58,148 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:54:58,148 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:54:58,149 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/29873cbdec4f487989fa6b226e794508, entries=4, sequenceid=9, filesize=5.4 K 2023-11-11 11:54:58,150 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family2/d5657159438b4fbca63c754f39f2182c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/d5657159438b4fbca63c754f39f2182c 2023-11-11 11:54:58,155 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/d5657159438b4fbca63c754f39f2182c, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 11:54:58,155 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 99dc75f3ad72a9db7000d7e9e3c61b9e in 1283ms, sequenceid=9, compaction requested=false 2023-11-11 11:54:58,155 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:54:58,156 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:54:58,156 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:54:58,156 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:54:58,156 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,156 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-11 11:54:58,156 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-11 11:54:58,160 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,160 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:58,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:58,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:58,160 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:58,160 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:58,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:58,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:58,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:58,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:58,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-11 11:54:58,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8291e9d[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:58,162 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-11 11:54:58,162 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:58,164 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:58,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:58,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:58,164 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-11 11:54:58,164 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-11 11:54:58,164 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:58,164 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,164 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:58,166 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-11 11:54:58,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:58,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:58,166 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-11 11:54:58,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:58,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:58,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:58,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:58,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:58,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:58,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-11 11:54:58,168 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-11 11:54:58,168 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:58,168 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:58,168 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-11 11:54:58,168 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:58,170 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:58,170 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:58,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:58,170 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:58,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:58,170 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:58,172 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,175 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,175 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:58,175 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:58,175 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:58,175 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:58,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-11 11:54:58,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:58,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-11 11:54:58,175 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:58,175 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:58,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:58,175 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:58,175 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:58,176 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:58,176 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:58,176 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:58,180 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 11:54:58,276 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:54:58,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:54:58,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:54:58,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:54:58,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:54:58,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:54:58,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-11 11:54:58,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-11 11:54:58,283 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-11 11:54:58,283 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:58,283 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-11 11:54:58,283 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-11 11:54:58,283 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:58,283 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:58,285 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,285 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:58,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:58,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:58,285 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:58,285 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:54:58,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:58,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:58,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:54:58,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:58,286 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-11 11:54:58,286 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-11 11:54:58,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-11 11:54:58,287 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-11 11:54:58,287 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:54:58,287 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-11 11:54:58,287 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:54:58,287 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:54:58,287 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:54:58,287 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:54:58,287 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:54:58,287 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. started... 2023-11-11 11:54:58,287 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. started... 2023-11-11 11:54:58,287 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. started... 2023-11-11 11:54:58,287 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing be5c328b64d96b557d201a387d04fa34 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 11:54:58,287 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 99dc75f3ad72a9db7000d7e9e3c61b9e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 11:54:58,287 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 998271c54a88643806fe1b6c1978d34b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 11:54:58,715 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111ed8985c28253472e8914a574c2a5f459 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111ed8985c28253472e8914a574c2a5f459 2023-11-11 11:54:58,719 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111112e576b4953241308f43e1d7537caea7 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111112e576b4953241308f43e1d7537caea7 2023-11-11 11:54:58,720 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311110f5a6e6593d040c48d839f16db759c68 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311110f5a6e6593d040c48d839f16db759c68 2023-11-11 11:54:58,725 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family1/bc013f1514074b72ab7fa367944ae56a 2023-11-11 11:54:59,129 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family1/18a5d622f2584a7aa1d534a3afdd65f8 2023-11-11 11:54:59,134 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family1/3059bb60a40d4f58b0f5c16a2a538640 2023-11-11 11:54:59,141 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111610e10038e014205927e397fc998f6bd to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111610e10038e014205927e397fc998f6bd 2023-11-11 11:54:59,143 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111e30fd8eda05240579841f2990ac51c60 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111e30fd8eda05240579841f2990ac51c60 2023-11-11 11:54:59,152 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family2/ab0d303fc8d74594a2b4e500f523eaaf 2023-11-11 11:54:59,155 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family1/18a5d622f2584a7aa1d534a3afdd65f8 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/18a5d622f2584a7aa1d534a3afdd65f8 2023-11-11 11:54:59,158 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/18a5d622f2584a7aa1d534a3afdd65f8, entries=4, sequenceid=13, filesize=5.4 K 2023-11-11 11:54:59,159 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family2/ab0d303fc8d74594a2b4e500f523eaaf as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/ab0d303fc8d74594a2b4e500f523eaaf 2023-11-11 11:54:59,162 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/ab0d303fc8d74594a2b4e500f523eaaf, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 11:54:59,162 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 998271c54a88643806fe1b6c1978d34b in 875ms, sequenceid=13, compaction requested=true 2023-11-11 11:54:59,163 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:54:59,163 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:54:59,163 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:54:59,551 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family2/9d9bfccacf39439892dc83099a14166c 2023-11-11 11:54:59,555 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311116fdaab1943794f2aa420188aa132ab06 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311116fdaab1943794f2aa420188aa132ab06 2023-11-11 11:54:59,556 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family1/bc013f1514074b72ab7fa367944ae56a as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bc013f1514074b72ab7fa367944ae56a 2023-11-11 11:54:59,561 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bc013f1514074b72ab7fa367944ae56a, entries=4, sequenceid=13, filesize=5.4 K 2023-11-11 11:54:59,562 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family2/9d9bfccacf39439892dc83099a14166c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/9d9bfccacf39439892dc83099a14166c 2023-11-11 11:54:59,566 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/9d9bfccacf39439892dc83099a14166c, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 11:54:59,567 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for be5c328b64d96b557d201a387d04fa34 in 1280ms, sequenceid=13, compaction requested=true 2023-11-11 11:54:59,567 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:54:59,567 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:54:59,567 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:54:59,962 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family2/8d5bc1c6ebe64c079b3099ada0941e2c 2023-11-11 11:54:59,966 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family1/3059bb60a40d4f58b0f5c16a2a538640 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/3059bb60a40d4f58b0f5c16a2a538640 2023-11-11 11:54:59,970 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/3059bb60a40d4f58b0f5c16a2a538640, entries=4, sequenceid=13, filesize=5.4 K 2023-11-11 11:54:59,971 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family2/8d5bc1c6ebe64c079b3099ada0941e2c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8d5bc1c6ebe64c079b3099ada0941e2c 2023-11-11 11:54:59,976 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8d5bc1c6ebe64c079b3099ada0941e2c, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 11:54:59,977 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 99dc75f3ad72a9db7000d7e9e3c61b9e in 1690ms, sequenceid=13, compaction requested=true 2023-11-11 11:54:59,977 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:54:59,977 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:54:59,977 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:54:59,977 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:54:59,977 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,977 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-11 11:54:59,977 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-11 11:54:59,979 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,979 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:59,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:59,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:59,979 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:59,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:59,979 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:54:59,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:59,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:59,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:59,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-11 11:54:59,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e746681[Count = 0] remaining members to acquire global barrier 2023-11-11 11:54:59,981 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-11 11:54:59,981 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:59,982 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:59,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:59,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:59,982 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,982 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:54:59,982 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-11 11:54:59,982 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-11 11:54:59,983 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:54:59,986 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-11 11:54:59,986 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,986 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:59,986 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-11 11:54:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:59,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:59,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:54:59,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-11 11:54:59,988 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-11 11:54:59,988 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:54:59,988 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:54:59,988 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-11 11:54:59,988 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:54:59,990 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:59,990 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:59,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:59,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:59,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:54:59,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:59,990 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:59,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:54:59,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:59,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:54:59,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:54:59,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:59,990 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:54:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,992 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:54:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:54:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,994 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:54:59,994 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:54:59,994 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:59,994 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:54:59,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-11 11:54:59,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:54:59,994 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:54:59,994 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:54:59,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:54:59,994 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:54:59,994 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:59,994 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:54:59,994 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:54:59,995 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-11 11:54:59,995 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:54:59,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:54:59,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:00,095 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:00,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:00,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:00,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:00,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:00,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:00,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:00,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-11 11:55:00,101 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-11 11:55:00,102 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:00,102 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-11 11:55:00,102 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-11 11:55:00,102 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:00,102 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:55:00,105 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:00,106 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:00,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:00,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:00,106 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:00,106 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:00,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:55:00,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:00,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:00,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:55:00,107 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-11 11:55:00,107 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-11 11:55:00,107 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-11 11:55:00,107 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-11 11:55:00,107 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:00,107 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-11 11:55:00,107 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:00,108 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. started... 2023-11-11 11:55:00,108 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:55:00,108 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:00,108 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:00,108 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:00,108 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 99dc75f3ad72a9db7000d7e9e3c61b9e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 11:55:00,108 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. started... 2023-11-11 11:55:00,108 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. started... 2023-11-11 11:55:00,108 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing be5c328b64d96b557d201a387d04fa34 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 11:55:00,108 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 998271c54a88643806fe1b6c1978d34b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 11:55:00,527 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311115ace58c02409485aa644851bced3e1d8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311115ace58c02409485aa644851bced3e1d8 2023-11-11 11:55:00,528 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111159ecc0e08f924e72aeec52ae71eb9868 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111159ecc0e08f924e72aeec52ae71eb9868 2023-11-11 11:55:00,528 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111d4e4d1956a6741ec803d37d6811a57bd to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111d4e4d1956a6741ec803d37d6811a57bd 2023-11-11 11:55:00,537 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family1/b2369b2c714d4f13aca25549fa4b665a 2023-11-11 11:55:00,538 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family1/10793340a817439e8690a88c1372b2d8 2023-11-11 11:55:00,552 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311113ebe7da4949847d4ab1bfbcb02b87137 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311113ebe7da4949847d4ab1bfbcb02b87137 2023-11-11 11:55:00,552 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111b874607a401d491a90123d43ae228a9a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111b874607a401d491a90123d43ae228a9a 2023-11-11 11:55:00,556 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family2/95cd2b2fb9d44b518c882621b5178950 2023-11-11 11:55:00,560 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family1/b2369b2c714d4f13aca25549fa4b665a as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/b2369b2c714d4f13aca25549fa4b665a 2023-11-11 11:55:00,563 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/b2369b2c714d4f13aca25549fa4b665a, entries=4, sequenceid=17, filesize=5.4 K 2023-11-11 11:55:00,564 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family2/95cd2b2fb9d44b518c882621b5178950 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/95cd2b2fb9d44b518c882621b5178950 2023-11-11 11:55:00,566 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/95cd2b2fb9d44b518c882621b5178950, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 11:55:00,567 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for be5c328b64d96b557d201a387d04fa34 in 459ms, sequenceid=17, compaction requested=true 2023-11-11 11:55:00,567 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:55:00,567 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:00,567 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:55:00,757 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-11 11:55:00,936 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family1/1fe03666af6842f8894e4837158d0d30 2023-11-11 11:55:00,957 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family2/8eada10ab82b4f0da7a7cdaab690121c 2023-11-11 11:55:00,960 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family1/10793340a817439e8690a88c1372b2d8 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/10793340a817439e8690a88c1372b2d8 2023-11-11 11:55:00,963 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/10793340a817439e8690a88c1372b2d8, entries=4, sequenceid=17, filesize=5.4 K 2023-11-11 11:55:00,964 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family2/8eada10ab82b4f0da7a7cdaab690121c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/8eada10ab82b4f0da7a7cdaab690121c 2023-11-11 11:55:00,967 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/8eada10ab82b4f0da7a7cdaab690121c, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 11:55:00,968 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 998271c54a88643806fe1b6c1978d34b in 860ms, sequenceid=17, compaction requested=true 2023-11-11 11:55:00,968 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:55:00,968 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:00,968 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:55:01,349 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111442f29961b20439ab732e455b9b851ae to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111442f29961b20439ab732e455b9b851ae 2023-11-11 11:55:01,754 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family2/79ad1493231d4d57ae1032371fed9f97 2023-11-11 11:55:01,758 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family1/1fe03666af6842f8894e4837158d0d30 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/1fe03666af6842f8894e4837158d0d30 2023-11-11 11:55:01,762 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/1fe03666af6842f8894e4837158d0d30, entries=4, sequenceid=17, filesize=5.4 K 2023-11-11 11:55:01,763 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family2/79ad1493231d4d57ae1032371fed9f97 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/79ad1493231d4d57ae1032371fed9f97 2023-11-11 11:55:01,766 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/79ad1493231d4d57ae1032371fed9f97, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 11:55:01,767 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 99dc75f3ad72a9db7000d7e9e3c61b9e in 1659ms, sequenceid=17, compaction requested=true 2023-11-11 11:55:01,767 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:55:01,767 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:01,767 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:55:01,767 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:55:01,767 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,767 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-11 11:55:01,767 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-11 11:55:01,769 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,769 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:01,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:01,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:01,769 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:01,769 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:01,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:01,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:01,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:55:01,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:01,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-11 11:55:01,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ea1dc8a[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:01,770 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-11 11:55:01,770 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:01,772 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:01,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:01,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:01,772 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-11 11:55:01,772 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-11 11:55:01,772 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:01,772 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,772 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:01,774 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:01,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:01,774 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-11 11:55:01,774 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:01,774 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-11 11:55:01,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:01,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:01,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:55:01,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:01,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:55:01,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:01,776 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-11 11:55:01,776 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:01,776 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:01,776 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-11 11:55:01,776 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:01,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-11 11:55:01,778 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:01,778 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:01,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:01,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:01,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:01,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:01,778 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:01,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:01,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:01,778 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:01,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:01,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:55:01,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:01,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:01,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:55:01,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,780 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:01,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:55:01,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,783 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,783 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:55:01,783 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:01,783 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:55:01,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:01,783 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:01,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-11 11:55:01,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:01,783 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:01,783 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:01,783 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:01,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:01,783 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:01,783 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:01,783 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:01,783 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:01,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:01,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:01,883 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:01,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:01,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 11:55:01,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699703701899 (current time:1699703701899). 2023-11-11 11:55:01,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-11 11:55:01,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] zookeeper.ReadOnlyZKClient(139): Connect 0x14076de3 to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:55:01,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14db077f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:55:01,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:55:01,917 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:55:01,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14076de3 to 127.0.0.1:59344 2023-11-11 11:55:01,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:55:01,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-11 11:55:01,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 11:55:01,931 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot, current working dir path: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot/.tmp/snaptb-1699703701885 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-11 11:55:01,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-11 11:55:01,938 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-11 11:55:01,939 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699704301939 2023-11-11 11:55:01,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 11:55:01,939 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1699703701885 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-11 11:55:01,941 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-11 11:55:01,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-11 11:55:01,942 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-11-11 11:55:01,942 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-11 11:55:01,942 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1699704301942 2023-11-11 11:55:01,944 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:01,944 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-11 11:55:02,044 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 11:55:02,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 11:55:02,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 11:55:02,048 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-11 11:55:02,249 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 11:55:02,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 11:55:02,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 11:55:02,250 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-11 11:55:02,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1699703701885 2023-11-11 11:55:02,350 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1699703701885' 2023-11-11 11:55:02,350 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-11 11:55:02,350 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1699703701885' starting 'acquire' 2023-11-11 11:55:02,350 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1699703701885', kicking off acquire phase on members. 2023-11-11 11:55:02,350 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699703701885 2023-11-11 11:55:02,350 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1699703701885 2023-11-11 11:55:02,352 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-11 11:55:02,352 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1699703701885/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-11 11:55:02,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-11 11:55:02,353 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1699703701885/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,353 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:02,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1699703701885 2023-11-11 11:55:02,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699703701885 2023-11-11 11:55:02,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-11 11:55:02,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1699703701885 2023-11-11 11:55:02,354 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1699703701885 from table testCompactionWithHFileLink type FLUSH 2023-11-11 11:55:02,356 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1699703701885 2023-11-11 11:55:02,356 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1699703701885' with timeout 300000ms 2023-11-11 11:55:02,356 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-11 11:55:02,356 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1699703701885' starting 'acquire' stage 2023-11-11 11:55:02,356 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1699703701885' locally acquired 2023-11-11 11:55:02,356 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (snaptb-1699703701885) in zk 2023-11-11 11:55:02,357 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699703701885/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,357 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1699703701885 2023-11-11 11:55:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1699703701885/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-11 11:55:02,358 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699703701885 2023-11-11 11:55:02,358 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1699703701885' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699703701885 2023-11-11 11:55:02,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:02,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'snaptb-1699703701885' on coordinator 2023-11-11 11:55:02,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@423f796a[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:02,359 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1699703701885' starting 'in-barrier' execution. 2023-11-11 11:55:02,359 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1699703701885 2023-11-11 11:55:02,362 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699703701885 2023-11-11 11:55:02,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1699703701885 2023-11-11 11:55:02,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1699703701885 2023-11-11 11:55:02,362 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1699703701885' received 'reached' from coordinator. 2023-11-11 11:55:02,362 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699703701885/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,362 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:02,363 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:02,363 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:02,363 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:02,363 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-11 11:55:02,363 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-11 11:55:02,363 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. started... 2023-11-11 11:55:02,363 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. started... 2023-11-11 11:55:02,363 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. started... 2023-11-11 11:55:02,363 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:55:02,363 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:55:02,363 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:55:02,364 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.' region-info for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,364 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.' region-info for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,364 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.' region-info for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,369 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-11 11:55:02,369 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-11 11:55:02,369 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-11 11:55:02,373 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/3738921820ab429a8b72082afee389a5, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/146911079b654a03a6e1e419f77709e2, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/18a5d622f2584a7aa1d534a3afdd65f8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/10793340a817439e8690a88c1372b2d8] hfiles 2023-11-11 11:55:02,373 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/6da56152861b4113921b3ffe3773b558, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/29873cbdec4f487989fa6b226e794508, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/3059bb60a40d4f58b0f5c16a2a538640, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/1fe03666af6842f8894e4837158d0d30] hfiles 2023-11-11 11:55:02,373 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/3738921820ab429a8b72082afee389a5 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,373 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bd9a2401a2a04526ab71e7964c181ab8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/825c734d3648470ea46c9a8cd735e032, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bc013f1514074b72ab7fa367944ae56a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/b2369b2c714d4f13aca25549fa4b665a] hfiles 2023-11-11 11:55:02,373 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/6da56152861b4113921b3ffe3773b558 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,373 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bd9a2401a2a04526ab71e7964c181ab8 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/29873cbdec4f487989fa6b226e794508 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/825c734d3648470ea46c9a8cd735e032 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/3059bb60a40d4f58b0f5c16a2a538640 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/1fe03666af6842f8894e4837158d0d30 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/146911079b654a03a6e1e419f77709e2 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bc013f1514074b72ab7fa367944ae56a for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/ca6ba7ef50234eea9235094f18b4172b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/d5657159438b4fbca63c754f39f2182c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8d5bc1c6ebe64c079b3099ada0941e2c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/79ad1493231d4d57ae1032371fed9f97] hfiles 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/18a5d622f2584a7aa1d534a3afdd65f8 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/ca6ba7ef50234eea9235094f18b4172b for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/b2369b2c714d4f13aca25549fa4b665a for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/d5657159438b4fbca63c754f39f2182c for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/f413166c047243caaea4d6a006096d73, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/af9aad0939ef4556ab0757d47af29d98, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/9d9bfccacf39439892dc83099a14166c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/95cd2b2fb9d44b518c882621b5178950] hfiles 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/10793340a817439e8690a88c1372b2d8 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/f413166c047243caaea4d6a006096d73 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/d136474a81d94d1e9a20a83d42568946, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/aa9650f16fef4fb2a0e814af62aa97d4, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/ab0d303fc8d74594a2b4e500f523eaaf, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/8eada10ab82b4f0da7a7cdaab690121c] hfiles 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8d5bc1c6ebe64c079b3099ada0941e2c for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,377 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/d136474a81d94d1e9a20a83d42568946 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/af9aad0939ef4556ab0757d47af29d98 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,377 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/aa9650f16fef4fb2a0e814af62aa97d4 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,377 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/79ad1493231d4d57ae1032371fed9f97 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,377 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/ab0d303fc8d74594a2b4e500f523eaaf for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,377 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/9d9bfccacf39439892dc83099a14166c for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,377 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/8eada10ab82b4f0da7a7cdaab690121c for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,377 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/95cd2b2fb9d44b518c882621b5178950 for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,550 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 11:55:02,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 11:55:02,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 11:55:02,551 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-11 11:55:02,783 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. completed. 2023-11-11 11:55:02,783 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. completed. 2023-11-11 11:55:02,783 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. completed. 2023-11-11 11:55:02,783 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:02,783 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:02,783 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:02,784 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-11 11:55:02,784 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-11 11:55:02,784 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-11 11:55:02,784 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-11 11:55:02,784 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,784 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1699703701885' locally completed 2023-11-11 11:55:02,784 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1699703701885' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:02,786 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699703701885/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,786 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1699703701885' has notified controller of completion 2023-11-11 11:55:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1699703701885/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-11 11:55:02,786 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:02,786 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1699703701885' completed. 2023-11-11 11:55:02,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699703701885 2023-11-11 11:55:02,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:02,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699703701885 2023-11-11 11:55:02,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1699703701885' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:02,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'snaptb-1699703701885', counting down latch. Waiting for 0 more 2023-11-11 11:55:02,789 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1699703701885' execution completed 2023-11-11 11:55:02,789 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:02,789 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:02,789 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1699703701885 2023-11-11 11:55:02,789 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1699703701885including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-11 11:55:02,791 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699703701885 2023-11-11 11:55:02,791 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699703701885 2023-11-11 11:55:02,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1699703701885 2023-11-11 11:55:02,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:02,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-11 11:55:02,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1699703701885 2023-11-11 11:55:02,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699703701885 2023-11-11 11:55:02,791 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-11 11:55:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:02,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-11 11:55:02,792 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1699703701885/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-11 11:55:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699703701885 2023-11-11 11:55:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699703701885 2023-11-11 11:55:02,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:02,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699703701885 2023-11-11 11:55:02,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,793 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1699703701885/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:02,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699703701885 2023-11-11 11:55:02,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,796 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699703701885/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,796 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699703701885 2023-11-11 11:55:02,796 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699703701885 2023-11-11 11:55:02,796 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699703701885/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:02,796 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-11 11:55:02,796 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699703701885 2023-11-11 11:55:02,796 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1699703701885 2023-11-11 11:55:02,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-11 11:55:02,796 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-11 11:55:02,796 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-11 11:55:02,796 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:02,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-11 11:55:02,796 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699703701885 2023-11-11 11:55:02,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1699703701885 because node does not exist (not an error) 2023-11-11 11:55:02,796 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699703701885 2023-11-11 11:55:02,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1699703701885 2023-11-11 11:55:02,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-11 11:55:02,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-11 11:55:02,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-11 11:55:02,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111112e576b4953241308f43e1d7537caea7, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111268f2ac8d9e44280bb779f3386228ee7, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311113d083de89f244dc1b8f891700d4b02f1, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111159ecc0e08f924e72aeec52ae71eb9868, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311114bc9a91b07384b3e8fda78dd5d92b84f, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111157b7dfde3a9f4e289de14ae640c58280, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111d4e4d1956a6741ec803d37d6811a57bd, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111ed8985c28253472e8914a574c2a5f459, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311110f5a6e6593d040c48d839f16db759c68, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311115ace58c02409485aa644851bced3e1d8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111d2a9790abffe4d8eb6cec085a7d80c30, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111dbbb4786da604d108b924c71130c6610] mob files 2023-11-11 11:55:02,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111112e576b4953241308f43e1d7537caea7 2023-11-11 11:55:02,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111268f2ac8d9e44280bb779f3386228ee7 2023-11-11 11:55:02,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311113d083de89f244dc1b8f891700d4b02f1 2023-11-11 11:55:02,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111159ecc0e08f924e72aeec52ae71eb9868 2023-11-11 11:55:02,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311114bc9a91b07384b3e8fda78dd5d92b84f 2023-11-11 11:55:02,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111157b7dfde3a9f4e289de14ae640c58280 2023-11-11 11:55:02,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111d4e4d1956a6741ec803d37d6811a57bd 2023-11-11 11:55:02,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111ed8985c28253472e8914a574c2a5f459 2023-11-11 11:55:02,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311110f5a6e6593d040c48d839f16db759c68 2023-11-11 11:55:02,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311115ace58c02409485aa644851bced3e1d8 2023-11-11 11:55:02,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111d2a9790abffe4d8eb6cec085a7d80c30 2023-11-11 11:55:02,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111dbbb4786da604d108b924c71130c6610 2023-11-11 11:55:02,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111137e9fe82b284a3ab6803d13e47385cc, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311111c32ac5521894ab98daaed0051f408f6, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111b874607a401d491a90123d43ae228a9a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111e30fd8eda05240579841f2990ac51c60, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311113ebe7da4949847d4ab1bfbcb02b87137, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111610e10038e014205927e397fc998f6bd, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111186844b5641d841c98eed4a8dcdd93eed, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111b06f1067a20242beba4ae0c7e2747a4d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111102f9b3368c3243d386bb3a3f42ab2ab7, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111442f29961b20439ab732e455b9b851ae, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311116fdaab1943794f2aa420188aa132ab06, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111c8a08260f649405594debdcc95d729cf] mob files 2023-11-11 11:55:02,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111137e9fe82b284a3ab6803d13e47385cc 2023-11-11 11:55:02,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311111c32ac5521894ab98daaed0051f408f6 2023-11-11 11:55:02,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111b874607a401d491a90123d43ae228a9a 2023-11-11 11:55:02,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111e30fd8eda05240579841f2990ac51c60 2023-11-11 11:55:02,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311113ebe7da4949847d4ab1bfbcb02b87137 2023-11-11 11:55:02,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111610e10038e014205927e397fc998f6bd 2023-11-11 11:55:02,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111186844b5641d841c98eed4a8dcdd93eed 2023-11-11 11:55:02,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111b06f1067a20242beba4ae0c7e2747a4d 2023-11-11 11:55:02,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111102f9b3368c3243d386bb3a3f42ab2ab7 2023-11-11 11:55:02,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111442f29961b20439ab732e455b9b851ae 2023-11-11 11:55:02,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311116fdaab1943794f2aa420188aa132ab06 2023-11-11 11:55:02,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111c8a08260f649405594debdcc95d729cf 2023-11-11 11:55:03,051 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 11:55:03,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 11:55:03,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 11:55:03,052 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-11 11:55:03,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1699703701885 2023-11-11 11:55:03,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot/.tmp/snaptb-1699703701885 2023-11-11 11:55:03,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot/.tmp/snaptb-1699703701885 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot/snaptb-1699703701885 2023-11-11 11:55:03,663 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1699703701885 of table testCompactionWithHFileLink completed 2023-11-11 11:55:03,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot/.tmp/snaptb-1699703701885 2023-11-11 11:55:03,664 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot/.tmp/snaptb-1699703701885 2023-11-11 11:55:03,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1699703701885 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699703701939Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1699703703205 (+1266 ms)Consolidate snapshot: snaptb-1699703701885 at 1699703703205Loading Region manifests for snaptb-1699703701885 at 1699703703205Writing data manifest for snaptb-1699703701885 at 1699703703215 (+10 ms)Verifying snapshot: snaptb-1699703701885 at 1699703703623 (+408 ms)Snapshot snaptb-1699703701885 of table testCompactionWithHFileLink completed at 1699703703663 (+40 ms) 2023-11-11 11:55:03,665 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-11 11:55:03,667 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.7240 sec 2023-11-11 11:55:04,052 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 11:55:04,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 11:55:04,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-11 11:55:04,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:04,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:04,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-11 11:55:04,085 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-11 11:55:04,085 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:04,085 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-11 11:55:04,085 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-11 11:55:04,086 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:04,086 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:55:04,088 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:04,088 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:04,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:04,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:04,088 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:04,088 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:04,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:55:04,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:55:04,089 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-11 11:55:04,089 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-11 11:55:04,089 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-11 11:55:04,089 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-11 11:55:04,089 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:04,090 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-11 11:55:04,090 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:04,090 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:04,090 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:55:04,090 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:04,090 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. started... 2023-11-11 11:55:04,090 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:04,090 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. started... 2023-11-11 11:55:04,090 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 99dc75f3ad72a9db7000d7e9e3c61b9e 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 11:55:04,090 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 998271c54a88643806fe1b6c1978d34b 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 11:55:04,090 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. started... 2023-11-11 11:55:04,090 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing be5c328b64d96b557d201a387d04fa34 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 11:55:04,106 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family1/d9e5af62987e485b956679c12c66056b 2023-11-11 11:55:04,109 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9e5af62987e485b956679c12c66056b 2023-11-11 11:55:04,505 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family1/8d49467233b6455585b2a2d3c47db706 2023-11-11 11:55:04,509 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d49467233b6455585b2a2d3c47db706 2023-11-11 11:55:04,533 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family2/6b93b495661a4f2099bb903688b89f45 2023-11-11 11:55:04,533 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family2/8c1fa80d752d4137a9b66a3ca700138f 2023-11-11 11:55:04,537 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b93b495661a4f2099bb903688b89f45 2023-11-11 11:55:04,537 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c1fa80d752d4137a9b66a3ca700138f 2023-11-11 11:55:04,538 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family1/d9e5af62987e485b956679c12c66056b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/d9e5af62987e485b956679c12c66056b 2023-11-11 11:55:04,538 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family1/8d49467233b6455585b2a2d3c47db706 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/8d49467233b6455585b2a2d3c47db706 2023-11-11 11:55:04,542 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9e5af62987e485b956679c12c66056b 2023-11-11 11:55:04,542 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/d9e5af62987e485b956679c12c66056b, entries=3, sequenceid=24, filesize=5.0 K 2023-11-11 11:55:04,542 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d49467233b6455585b2a2d3c47db706 2023-11-11 11:55:04,543 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/8d49467233b6455585b2a2d3c47db706, entries=3, sequenceid=24, filesize=5.0 K 2023-11-11 11:55:04,543 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family2/6b93b495661a4f2099bb903688b89f45 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/6b93b495661a4f2099bb903688b89f45 2023-11-11 11:55:04,544 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family2/8c1fa80d752d4137a9b66a3ca700138f as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8c1fa80d752d4137a9b66a3ca700138f 2023-11-11 11:55:04,551 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b93b495661a4f2099bb903688b89f45 2023-11-11 11:55:04,551 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/6b93b495661a4f2099bb903688b89f45, entries=1, sequenceid=24, filesize=5.0 K 2023-11-11 11:55:04,552 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c1fa80d752d4137a9b66a3ca700138f 2023-11-11 11:55:04,552 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8c1fa80d752d4137a9b66a3ca700138f, entries=1, sequenceid=24, filesize=5.0 K 2023-11-11 11:55:04,552 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for be5c328b64d96b557d201a387d04fa34 in 462ms, sequenceid=24, compaction requested=true 2023-11-11 11:55:04,552 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:55:04,552 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:04,552 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:55:04,553 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 99dc75f3ad72a9db7000d7e9e3c61b9e in 463ms, sequenceid=24, compaction requested=true 2023-11-11 11:55:04,553 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:55:04,553 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:04,553 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:55:04,908 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family1/8827da3287664d2db0ffd9a287863a6b 2023-11-11 11:55:04,912 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8827da3287664d2db0ffd9a287863a6b 2023-11-11 11:55:05,728 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family2/06af62aa17354f938fe8a62aebb58bbb 2023-11-11 11:55:05,732 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06af62aa17354f938fe8a62aebb58bbb 2023-11-11 11:55:05,733 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family1/8827da3287664d2db0ffd9a287863a6b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/8827da3287664d2db0ffd9a287863a6b 2023-11-11 11:55:05,736 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8827da3287664d2db0ffd9a287863a6b 2023-11-11 11:55:05,736 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/8827da3287664d2db0ffd9a287863a6b, entries=3, sequenceid=24, filesize=5.0 K 2023-11-11 11:55:05,737 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family2/06af62aa17354f938fe8a62aebb58bbb as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/06af62aa17354f938fe8a62aebb58bbb 2023-11-11 11:55:05,740 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06af62aa17354f938fe8a62aebb58bbb 2023-11-11 11:55:05,740 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/06af62aa17354f938fe8a62aebb58bbb, entries=1, sequenceid=24, filesize=5.0 K 2023-11-11 11:55:05,741 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 998271c54a88643806fe1b6c1978d34b in 1651ms, sequenceid=24, compaction requested=true 2023-11-11 11:55:05,741 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:55:05,741 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:05,741 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:55:05,741 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:55:05,741 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,742 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-11 11:55:05,742 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-11 11:55:05,744 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,744 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:05,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:05,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:05,744 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:05,744 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:05,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:05,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:05,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:55:05,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:05,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-11 11:55:05,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2225a46[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:05,745 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-11 11:55:05,746 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:05,747 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:05,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:05,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:05,747 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-11 11:55:05,747 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-11 11:55:05,747 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,747 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:05,747 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:05,749 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,749 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-11 11:55:05,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:05,749 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:05,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:05,749 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-11 11:55:05,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:05,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:05,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:55:05,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:05,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:55:05,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:05,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-11 11:55:05,751 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-11 11:55:05,751 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:05,751 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:05,751 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-11 11:55:05,751 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:05,753 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:05,753 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:05,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:05,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:05,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:05,753 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:05,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:05,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:05,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:05,753 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:05,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:05,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:55:05,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:05,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:05,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:55:05,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,755 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:05,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-11 11:55:05,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,757 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,757 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:05,757 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:55:05,757 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:05,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-11 11:55:05,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:05,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:05,757 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-11 11:55:05,757 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:05,757 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:05,757 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:05,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:05,758 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:05,757 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:05,758 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-11 11:55:05,758 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-11 11:55:05,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:05,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:05,858 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:05,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:05,859 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:05,859 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 is initiating major compaction (all files) 2023-11-11 11:55:05,860 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:55:05,860 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:55:05,860 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 in testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:05,860 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/6da56152861b4113921b3ffe3773b558, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/29873cbdec4f487989fa6b226e794508, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/3059bb60a40d4f58b0f5c16a2a538640, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/1fe03666af6842f8894e4837158d0d30, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/8d49467233b6455585b2a2d3c47db706] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp, totalSize=26.7 K 2023-11-11 11:55:05,861 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 6da56152861b4113921b3ffe3773b558, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703695070 2023-11-11 11:55:05,861 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 29873cbdec4f487989fa6b226e794508, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703696862 2023-11-11 11:55:05,862 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 3059bb60a40d4f58b0f5c16a2a538640, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703698278 2023-11-11 11:55:05,862 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 1fe03666af6842f8894e4837158d0d30, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703700097 2023-11-11 11:55:05,862 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 8d49467233b6455585b2a2d3c47db706, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-11 11:55:05,881 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): 99dc75f3ad72a9db7000d7e9e3c61b9e#family1#compaction#107 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:06,260 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 11:55:06,291 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231111a109d9063ec8464a98cf0f71903aac48_del 2023-11-11 11:55:06,291 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111a109d9063ec8464a98cf0f71903aac48_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111a109d9063ec8464a98cf0f71903aac48_del 2023-11-11 11:55:07,104 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78dc8454749e4a64a103c5d80a04ce50 2023-11-11 11:55:07,105 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family1/78dc8454749e4a64a103c5d80a04ce50 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/78dc8454749e4a64a103c5d80a04ce50 2023-11-11 11:55:07,108 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 78dc8454749e4a64a103c5d80a04ce50 2023-11-11 11:55:07,109 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 of 99dc75f3ad72a9db7000d7e9e3c61b9e into 78dc8454749e4a64a103c5d80a04ce50(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:55:07,110 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:55:07,110 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:07,110 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): 99dc75f3ad72a9db7000d7e9e3c61b9e/family2 is initiating major compaction (all files) 2023-11-11 11:55:07,110 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:55:07,110 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:55:07,111 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of 99dc75f3ad72a9db7000d7e9e3c61b9e/family2 in testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:07,111 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/ca6ba7ef50234eea9235094f18b4172b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/d5657159438b4fbca63c754f39f2182c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8d5bc1c6ebe64c079b3099ada0941e2c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/79ad1493231d4d57ae1032371fed9f97, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8c1fa80d752d4137a9b66a3ca700138f] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp, totalSize=25.4 K 2023-11-11 11:55:07,111 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting ca6ba7ef50234eea9235094f18b4172b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703695070 2023-11-11 11:55:07,112 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting d5657159438b4fbca63c754f39f2182c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703696862 2023-11-11 11:55:07,112 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 8d5bc1c6ebe64c079b3099ada0941e2c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703698278 2023-11-11 11:55:07,112 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 79ad1493231d4d57ae1032371fed9f97, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703700097 2023-11-11 11:55:07,112 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 8c1fa80d752d4137a9b66a3ca700138f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-11 11:55:07,123 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): 99dc75f3ad72a9db7000d7e9e3c61b9e#family2#compaction#108 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:07,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/6da56152861b4113921b3ffe3773b558, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/29873cbdec4f487989fa6b226e794508, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/3059bb60a40d4f58b0f5c16a2a538640, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/1fe03666af6842f8894e4837158d0d30, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/8d49467233b6455585b2a2d3c47db706] to archive 2023-11-11 11:55:07,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:07,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/6da56152861b4113921b3ffe3773b558 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/6da56152861b4113921b3ffe3773b558 2023-11-11 11:55:07,171 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/29873cbdec4f487989fa6b226e794508 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/29873cbdec4f487989fa6b226e794508 2023-11-11 11:55:07,171 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/3059bb60a40d4f58b0f5c16a2a538640 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/3059bb60a40d4f58b0f5c16a2a538640 2023-11-11 11:55:07,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/1fe03666af6842f8894e4837158d0d30 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/1fe03666af6842f8894e4837158d0d30 2023-11-11 11:55:07,173 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/8d49467233b6455585b2a2d3c47db706 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/8d49467233b6455585b2a2d3c47db706 2023-11-11 11:55:07,532 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231111f352fd9f0d434101bb06ff17984c8d0a_del 2023-11-11 11:55:07,532 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111f352fd9f0d434101bb06ff17984c8d0a_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111f352fd9f0d434101bb06ff17984c8d0a_del 2023-11-11 11:55:08,346 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 611a5993d46e4417b145c8053f959c2b 2023-11-11 11:55:08,347 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family2/611a5993d46e4417b145c8053f959c2b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/611a5993d46e4417b145c8053f959c2b 2023-11-11 11:55:08,351 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 611a5993d46e4417b145c8053f959c2b 2023-11-11 11:55:08,352 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 99dc75f3ad72a9db7000d7e9e3c61b9e/family2 of 99dc75f3ad72a9db7000d7e9e3c61b9e into 611a5993d46e4417b145c8053f959c2b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:55:08,352 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:55:08,352 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:08,352 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): 998271c54a88643806fe1b6c1978d34b/family1 is initiating major compaction (all files) 2023-11-11 11:55:08,352 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:55:08,352 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:55:08,352 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of 998271c54a88643806fe1b6c1978d34b/family1 in testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:08,353 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/3738921820ab429a8b72082afee389a5, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/146911079b654a03a6e1e419f77709e2, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/18a5d622f2584a7aa1d534a3afdd65f8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/10793340a817439e8690a88c1372b2d8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/8827da3287664d2db0ffd9a287863a6b] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp, totalSize=26.7 K 2023-11-11 11:55:08,353 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 3738921820ab429a8b72082afee389a5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703695071 2023-11-11 11:55:08,353 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 146911079b654a03a6e1e419f77709e2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703696863 2023-11-11 11:55:08,354 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 18a5d622f2584a7aa1d534a3afdd65f8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703698278 2023-11-11 11:55:08,354 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 10793340a817439e8690a88c1372b2d8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703700097 2023-11-11 11:55:08,355 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 8827da3287664d2db0ffd9a287863a6b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-11 11:55:08,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/ca6ba7ef50234eea9235094f18b4172b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/d5657159438b4fbca63c754f39f2182c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8d5bc1c6ebe64c079b3099ada0941e2c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/79ad1493231d4d57ae1032371fed9f97, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8c1fa80d752d4137a9b66a3ca700138f] to archive 2023-11-11 11:55:08,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:08,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/ca6ba7ef50234eea9235094f18b4172b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/ca6ba7ef50234eea9235094f18b4172b 2023-11-11 11:55:08,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/d5657159438b4fbca63c754f39f2182c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/d5657159438b4fbca63c754f39f2182c 2023-11-11 11:55:08,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8d5bc1c6ebe64c079b3099ada0941e2c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8d5bc1c6ebe64c079b3099ada0941e2c 2023-11-11 11:55:08,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/79ad1493231d4d57ae1032371fed9f97 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/79ad1493231d4d57ae1032371fed9f97 2023-11-11 11:55:08,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8c1fa80d752d4137a9b66a3ca700138f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/8c1fa80d752d4137a9b66a3ca700138f 2023-11-11 11:55:08,379 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): 998271c54a88643806fe1b6c1978d34b#family1#compaction#109 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:08,388 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231111510389692eb54d5e803b9c28b14f9afd_del 2023-11-11 11:55:08,388 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111510389692eb54d5e803b9c28b14f9afd_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111510389692eb54d5e803b9c28b14f9afd_del 2023-11-11 11:55:09,204 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e01adc6a9d554afeab2c283a90116f5c 2023-11-11 11:55:09,205 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family1/e01adc6a9d554afeab2c283a90116f5c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/e01adc6a9d554afeab2c283a90116f5c 2023-11-11 11:55:09,209 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e01adc6a9d554afeab2c283a90116f5c 2023-11-11 11:55:09,210 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 998271c54a88643806fe1b6c1978d34b/family1 of 998271c54a88643806fe1b6c1978d34b into e01adc6a9d554afeab2c283a90116f5c(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:55:09,210 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:55:09,210 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:09,210 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): 998271c54a88643806fe1b6c1978d34b/family2 is initiating major compaction (all files) 2023-11-11 11:55:09,210 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:55:09,211 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:55:09,211 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of 998271c54a88643806fe1b6c1978d34b/family2 in testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:09,211 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/d136474a81d94d1e9a20a83d42568946, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/aa9650f16fef4fb2a0e814af62aa97d4, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/ab0d303fc8d74594a2b4e500f523eaaf, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/8eada10ab82b4f0da7a7cdaab690121c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/06af62aa17354f938fe8a62aebb58bbb] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp, totalSize=25.4 K 2023-11-11 11:55:09,211 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting d136474a81d94d1e9a20a83d42568946, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703695071 2023-11-11 11:55:09,211 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting aa9650f16fef4fb2a0e814af62aa97d4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703696863 2023-11-11 11:55:09,212 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting ab0d303fc8d74594a2b4e500f523eaaf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703698278 2023-11-11 11:55:09,212 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 8eada10ab82b4f0da7a7cdaab690121c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703700097 2023-11-11 11:55:09,212 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 06af62aa17354f938fe8a62aebb58bbb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-11 11:55:09,224 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): 998271c54a88643806fe1b6c1978d34b#family2#compaction#110 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:09,265 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/3738921820ab429a8b72082afee389a5, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/146911079b654a03a6e1e419f77709e2, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/18a5d622f2584a7aa1d534a3afdd65f8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/10793340a817439e8690a88c1372b2d8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/8827da3287664d2db0ffd9a287863a6b] to archive 2023-11-11 11:55:09,266 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:09,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/3738921820ab429a8b72082afee389a5 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/3738921820ab429a8b72082afee389a5 2023-11-11 11:55:09,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/146911079b654a03a6e1e419f77709e2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/146911079b654a03a6e1e419f77709e2 2023-11-11 11:55:09,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/18a5d622f2584a7aa1d534a3afdd65f8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/18a5d622f2584a7aa1d534a3afdd65f8 2023-11-11 11:55:09,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/10793340a817439e8690a88c1372b2d8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/10793340a817439e8690a88c1372b2d8 2023-11-11 11:55:09,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/8827da3287664d2db0ffd9a287863a6b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/8827da3287664d2db0ffd9a287863a6b 2023-11-11 11:55:09,633 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311112b79e4b815d54327bbfdbdb02d0fc48b_del 2023-11-11 11:55:09,633 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311112b79e4b815d54327bbfdbdb02d0fc48b_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311112b79e4b815d54327bbfdbdb02d0fc48b_del 2023-11-11 11:55:10,446 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb881992324b4690932e4651fe9d1d53 2023-11-11 11:55:10,447 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family2/eb881992324b4690932e4651fe9d1d53 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/eb881992324b4690932e4651fe9d1d53 2023-11-11 11:55:10,451 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb881992324b4690932e4651fe9d1d53 2023-11-11 11:55:10,451 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 998271c54a88643806fe1b6c1978d34b/family2 of 998271c54a88643806fe1b6c1978d34b into eb881992324b4690932e4651fe9d1d53(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:55:10,452 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:55:10,452 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:10,452 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): be5c328b64d96b557d201a387d04fa34/family1 is initiating major compaction (all files) 2023-11-11 11:55:10,452 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:55:10,452 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:55:10,452 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of be5c328b64d96b557d201a387d04fa34/family1 in testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:10,452 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bd9a2401a2a04526ab71e7964c181ab8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/825c734d3648470ea46c9a8cd735e032, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bc013f1514074b72ab7fa367944ae56a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/b2369b2c714d4f13aca25549fa4b665a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/d9e5af62987e485b956679c12c66056b] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp, totalSize=26.7 K 2023-11-11 11:55:10,453 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting bd9a2401a2a04526ab71e7964c181ab8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703695072 2023-11-11 11:55:10,453 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 825c734d3648470ea46c9a8cd735e032, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703696863 2023-11-11 11:55:10,453 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting bc013f1514074b72ab7fa367944ae56a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703698278 2023-11-11 11:55:10,454 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting b2369b2c714d4f13aca25549fa4b665a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703700097 2023-11-11 11:55:10,454 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting d9e5af62987e485b956679c12c66056b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-11 11:55:10,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/d136474a81d94d1e9a20a83d42568946, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/aa9650f16fef4fb2a0e814af62aa97d4, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/ab0d303fc8d74594a2b4e500f523eaaf, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/8eada10ab82b4f0da7a7cdaab690121c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/06af62aa17354f938fe8a62aebb58bbb] to archive 2023-11-11 11:55:10,466 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): be5c328b64d96b557d201a387d04fa34#family1#compaction#111 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:10,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:10,468 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/d136474a81d94d1e9a20a83d42568946 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/d136474a81d94d1e9a20a83d42568946 2023-11-11 11:55:10,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/aa9650f16fef4fb2a0e814af62aa97d4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/aa9650f16fef4fb2a0e814af62aa97d4 2023-11-11 11:55:10,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/ab0d303fc8d74594a2b4e500f523eaaf to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/ab0d303fc8d74594a2b4e500f523eaaf 2023-11-11 11:55:10,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/8eada10ab82b4f0da7a7cdaab690121c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/8eada10ab82b4f0da7a7cdaab690121c 2023-11-11 11:55:10,473 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/06af62aa17354f938fe8a62aebb58bbb to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/06af62aa17354f938fe8a62aebb58bbb 2023-11-11 11:55:10,878 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231111723a17ece5ba4c679ae8044d4a2633e8_del 2023-11-11 11:55:10,878 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111723a17ece5ba4c679ae8044d4a2633e8_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111723a17ece5ba4c679ae8044d4a2633e8_del 2023-11-11 11:55:11,693 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de58baf94f0843c8880f522fb8140a4b 2023-11-11 11:55:11,694 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family1/de58baf94f0843c8880f522fb8140a4b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/de58baf94f0843c8880f522fb8140a4b 2023-11-11 11:55:11,700 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de58baf94f0843c8880f522fb8140a4b 2023-11-11 11:55:11,702 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in be5c328b64d96b557d201a387d04fa34/family1 of be5c328b64d96b557d201a387d04fa34 into de58baf94f0843c8880f522fb8140a4b(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:55:11,702 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:55:11,702 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:11,702 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): be5c328b64d96b557d201a387d04fa34/family2 is initiating major compaction (all files) 2023-11-11 11:55:11,702 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:55:11,702 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:55:11,702 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of be5c328b64d96b557d201a387d04fa34/family2 in testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:11,702 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/f413166c047243caaea4d6a006096d73, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/af9aad0939ef4556ab0757d47af29d98, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/9d9bfccacf39439892dc83099a14166c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/95cd2b2fb9d44b518c882621b5178950, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/6b93b495661a4f2099bb903688b89f45] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp, totalSize=25.4 K 2023-11-11 11:55:11,703 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting f413166c047243caaea4d6a006096d73, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703695072 2023-11-11 11:55:11,703 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting af9aad0939ef4556ab0757d47af29d98, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703696863 2023-11-11 11:55:11,703 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 9d9bfccacf39439892dc83099a14166c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703698278 2023-11-11 11:55:11,704 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 95cd2b2fb9d44b518c882621b5178950, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703700097 2023-11-11 11:55:11,704 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 6b93b495661a4f2099bb903688b89f45, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-11 11:55:11,719 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): be5c328b64d96b557d201a387d04fa34#family2#compaction#112 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:11,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bd9a2401a2a04526ab71e7964c181ab8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/825c734d3648470ea46c9a8cd735e032, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bc013f1514074b72ab7fa367944ae56a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/b2369b2c714d4f13aca25549fa4b665a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/d9e5af62987e485b956679c12c66056b] to archive 2023-11-11 11:55:11,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:11,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bd9a2401a2a04526ab71e7964c181ab8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bd9a2401a2a04526ab71e7964c181ab8 2023-11-11 11:55:11,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/825c734d3648470ea46c9a8cd735e032 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/825c734d3648470ea46c9a8cd735e032 2023-11-11 11:55:11,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bc013f1514074b72ab7fa367944ae56a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/bc013f1514074b72ab7fa367944ae56a 2023-11-11 11:55:11,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/b2369b2c714d4f13aca25549fa4b665a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/b2369b2c714d4f13aca25549fa4b665a 2023-11-11 11:55:11,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/d9e5af62987e485b956679c12c66056b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/d9e5af62987e485b956679c12c66056b 2023-11-11 11:55:12,130 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231111c4403cc3ccf5454a80d620ee220029df_del 2023-11-11 11:55:12,130 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111c4403cc3ccf5454a80d620ee220029df_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111c4403cc3ccf5454a80d620ee220029df_del 2023-11-11 11:55:12,945 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85d312078428409bb8fd987d6233d7ba 2023-11-11 11:55:12,946 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family2/85d312078428409bb8fd987d6233d7ba as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/85d312078428409bb8fd987d6233d7ba 2023-11-11 11:55:12,950 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85d312078428409bb8fd987d6233d7ba 2023-11-11 11:55:12,951 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in be5c328b64d96b557d201a387d04fa34/family2 of be5c328b64d96b557d201a387d04fa34 into 85d312078428409bb8fd987d6233d7ba(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:55:12,951 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:55:12,957 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:12,960 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:12,964 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:12,965 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:12,971 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-11 11:55:12,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/f413166c047243caaea4d6a006096d73, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/af9aad0939ef4556ab0757d47af29d98, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/9d9bfccacf39439892dc83099a14166c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/95cd2b2fb9d44b518c882621b5178950, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/6b93b495661a4f2099bb903688b89f45] to archive 2023-11-11 11:55:12,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:12,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/f413166c047243caaea4d6a006096d73 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/f413166c047243caaea4d6a006096d73 2023-11-11 11:55:12,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/af9aad0939ef4556ab0757d47af29d98 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/af9aad0939ef4556ab0757d47af29d98 2023-11-11 11:55:12,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/9d9bfccacf39439892dc83099a14166c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/9d9bfccacf39439892dc83099a14166c 2023-11-11 11:55:12,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/95cd2b2fb9d44b518c882621b5178950 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/95cd2b2fb9d44b518c882621b5178950 2023-11-11 11:55:12,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/6b93b495661a4f2099bb903688b89f45 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/6b93b495661a4f2099bb903688b89f45 2023-11-11 11:55:13,008 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-11 11:55:13,011 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231111a109d9063ec8464a98cf0f71903aac48_del 2023-11-11 11:55:13,014 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231111510389692eb54d5e803b9c28b14f9afd_del 2023-11-11 11:55:13,016 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231111723a17ece5ba4c679ae8044d4a2633e8_del 2023-11-11 11:55:13,016 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:13,017 DEBUG [Listener at localhost/39241] zookeeper.ReadOnlyZKClient(139): Connect 0x6206c887 to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:55:13,022 DEBUG [Listener at localhost/39241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@577dcbf2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:55:13,023 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 11:55:13,023 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 11:55:13,023 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 11:55:13,485 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111152558ae79c6142088b8a33fdf70eb1a0 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111152558ae79c6142088b8a33fdf70eb1a0 2023-11-11 11:55:13,486 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:13,486 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111443abcbff0d74ee9802320d0b79c5a9c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111443abcbff0d74ee9802320d0b79c5a9c 2023-11-11 11:55:13,487 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:13,500 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:55:13,504 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:55:13,509 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:55:13,511 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:55:13,522 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/e80cddf147d8427e9ecfb45d3be45bc8 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-11 11:55:13,522 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/28dcb19149a34a48a2d9b9b7e0401156 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-11 11:55:13,524 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/e80cddf147d8427e9ecfb45d3be45bc8}] 2023-11-11 11:55:13,524 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/28dcb19149a34a48a2d9b9b7e0401156}] 2023-11-11 11:55:13,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/28dcb19149a34a48a2d9b9b7e0401156 for inclusion in be5c328b64d96b557d201a387d04fa34/family1 2023-11-11 11:55:13,528 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/e80cddf147d8427e9ecfb45d3be45bc8 for inclusion in 998271c54a88643806fe1b6c1978d34b/family1 2023-11-11 11:55:13,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-11 11:55:13,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-11 11:55:13,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-11 11:55:13,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-11 11:55:13,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:55:13,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:55:13,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/28dcb19149a34a48a2d9b9b7e0401156 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__blu76tr4sftbib07s0jkfi3insrs1uq06j0k67q7foeu2ebuj4jhnj3hvqif20ln/family1/28dcb19149a34a48a2d9b9b7e0401156 2023-11-11 11:55:13,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/e80cddf147d8427e9ecfb45d3be45bc8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__hu219bmlmt38nmhnmn6vd9bg232jfkfke19h5csdjj16mgouj9pl26dod4tiuo88/family1/e80cddf147d8427e9ecfb45d3be45bc8 2023-11-11 11:55:13,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__hu219bmlmt38nmhnmn6vd9bg232jfkfke19h5csdjj16mgouj9pl26dod4tiuo88/family1/e80cddf147d8427e9ecfb45d3be45bc8 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/cff57e2b974a432c9cb5d405422f22db_SeqId_29_ 2023-11-11 11:55:13,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__blu76tr4sftbib07s0jkfi3insrs1uq06j0k67q7foeu2ebuj4jhnj3hvqif20ln/family1/28dcb19149a34a48a2d9b9b7e0401156 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/2fd4f1234c21430994d46552aa832dc6_SeqId_29_ 2023-11-11 11:55:13,533 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__hu219bmlmt38nmhnmn6vd9bg232jfkfke19h5csdjj16mgouj9pl26dod4tiuo88/family1/e80cddf147d8427e9ecfb45d3be45bc8 into 998271c54a88643806fe1b6c1978d34b/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/cff57e2b974a432c9cb5d405422f22db_SeqId_29_ - updating store file list. 2023-11-11 11:55:13,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__blu76tr4sftbib07s0jkfi3insrs1uq06j0k67q7foeu2ebuj4jhnj3hvqif20ln/family1/28dcb19149a34a48a2d9b9b7e0401156 into be5c328b64d96b557d201a387d04fa34/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/2fd4f1234c21430994d46552aa832dc6_SeqId_29_ - updating store file list. 2023-11-11 11:55:13,536 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/cff57e2b974a432c9cb5d405422f22db_SeqId_29_ into 998271c54a88643806fe1b6c1978d34b/family1 2023-11-11 11:55:13,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__hu219bmlmt38nmhnmn6vd9bg232jfkfke19h5csdjj16mgouj9pl26dod4tiuo88/family1/e80cddf147d8427e9ecfb45d3be45bc8 into 998271c54a88643806fe1b6c1978d34b/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/cff57e2b974a432c9cb5d405422f22db_SeqId_29_) 2023-11-11 11:55:13,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/2fd4f1234c21430994d46552aa832dc6_SeqId_29_ into be5c328b64d96b557d201a387d04fa34/family1 2023-11-11 11:55:13,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__blu76tr4sftbib07s0jkfi3insrs1uq06j0k67q7foeu2ebuj4jhnj3hvqif20ln/family1/28dcb19149a34a48a2d9b9b7e0401156 into be5c328b64d96b557d201a387d04fa34/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/2fd4f1234c21430994d46552aa832dc6_SeqId_29_) 2023-11-11 11:55:13,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__hu219bmlmt38nmhnmn6vd9bg232jfkfke19h5csdjj16mgouj9pl26dod4tiuo88/family1/e80cddf147d8427e9ecfb45d3be45bc8 2023-11-11 11:55:13,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__blu76tr4sftbib07s0jkfi3insrs1uq06j0k67q7foeu2ebuj4jhnj3hvqif20ln/family1/28dcb19149a34a48a2d9b9b7e0401156 2023-11-11 11:55:13,539 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:13,539 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:13,539 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:13,539 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:13,540 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111112e576b4953241308f43e1d7537caea7 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111112e576b4953241308f43e1d7537caea7 2023-11-11 11:55:13,540 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311114bc9a91b07384b3e8fda78dd5d92b84f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311114bc9a91b07384b3e8fda78dd5d92b84f 2023-11-11 11:55:13,542 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111268f2ac8d9e44280bb779f3386228ee7 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111268f2ac8d9e44280bb779f3386228ee7 2023-11-11 11:55:13,542 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111157b7dfde3a9f4e289de14ae640c58280 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111157b7dfde3a9f4e289de14ae640c58280 2023-11-11 11:55:13,543 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311113d083de89f244dc1b8f891700d4b02f1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311113d083de89f244dc1b8f891700d4b02f1 2023-11-11 11:55:13,543 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111d4e4d1956a6741ec803d37d6811a57bd to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111d4e4d1956a6741ec803d37d6811a57bd 2023-11-11 11:55:13,543 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111159ecc0e08f924e72aeec52ae71eb9868 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111159ecc0e08f924e72aeec52ae71eb9868 2023-11-11 11:55:13,543 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-11 11:55:13,543 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111ed8985c28253472e8914a574c2a5f459 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111ed8985c28253472e8914a574c2a5f459 2023-11-11 11:55:13,544 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111' 2023-11-11 11:55:13,544 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-11 11:55:13,544 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111' 2023-11-11 11:55:13,544 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 11:55:13,544 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 11:55:13,885 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111117ed95571ea7429b90dbae9d437a621d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111117ed95571ea7429b90dbae9d437a621d 2023-11-11 11:55:13,886 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:13,909 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/1645b1dc72034a3092f72dcefa690c5d first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-11 11:55:13,910 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/1645b1dc72034a3092f72dcefa690c5d}] 2023-11-11 11:55:13,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/1645b1dc72034a3092f72dcefa690c5d for inclusion in 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 2023-11-11 11:55:13,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-11 11:55:13,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last=1 2023-11-11 11:55:13,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:55:13,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/1645b1dc72034a3092f72dcefa690c5d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__s5e3vdkan9mdupe9905th0cn5sc12egp013gb9cqm76f6ih38vdpvmbfdteq1qqe/family1/1645b1dc72034a3092f72dcefa690c5d 2023-11-11 11:55:13,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__s5e3vdkan9mdupe9905th0cn5sc12egp013gb9cqm76f6ih38vdpvmbfdteq1qqe/family1/1645b1dc72034a3092f72dcefa690c5d as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/453e70062391478c97e1383a6731dc24_SeqId_29_ 2023-11-11 11:55:13,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__s5e3vdkan9mdupe9905th0cn5sc12egp013gb9cqm76f6ih38vdpvmbfdteq1qqe/family1/1645b1dc72034a3092f72dcefa690c5d into 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/453e70062391478c97e1383a6731dc24_SeqId_29_ - updating store file list. 2023-11-11 11:55:13,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/453e70062391478c97e1383a6731dc24_SeqId_29_ into 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 2023-11-11 11:55:13,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__s5e3vdkan9mdupe9905th0cn5sc12egp013gb9cqm76f6ih38vdpvmbfdteq1qqe/family1/1645b1dc72034a3092f72dcefa690c5d into 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/453e70062391478c97e1383a6731dc24_SeqId_29_) 2023-11-11 11:55:13,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__s5e3vdkan9mdupe9905th0cn5sc12egp013gb9cqm76f6ih38vdpvmbfdteq1qqe/family1/1645b1dc72034a3092f72dcefa690c5d 2023-11-11 11:55:13,927 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:13,928 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:13,930 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311110f5a6e6593d040c48d839f16db759c68 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311110f5a6e6593d040c48d839f16db759c68 2023-11-11 11:55:13,931 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311115ace58c02409485aa644851bced3e1d8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311115ace58c02409485aa644851bced3e1d8 2023-11-11 11:55:13,932 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111d2a9790abffe4d8eb6cec085a7d80c30 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111d2a9790abffe4d8eb6cec085a7d80c30 2023-11-11 11:55:13,933 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111dbbb4786da604d108b924c71130c6610 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111dbbb4786da604d108b924c71130c6610 2023-11-11 11:55:13,934 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-11 11:55:13,934 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111' 2023-11-11 11:55:13,934 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 11:55:13,934 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:13,934 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 11:55:13,934 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111a109d9063ec8464a98cf0f71903aac48_del] 2023-11-11 11:55:13,935 DEBUG [Listener at localhost/39241] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:13,937 DEBUG [Listener at localhost/39241] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111a109d9063ec8464a98cf0f71903aac48_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231111a109d9063ec8464a98cf0f71903aac48_del 2023-11-11 11:55:13,937 INFO [Listener at localhost/39241] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-11 11:55:13,937 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111510389692eb54d5e803b9c28b14f9afd_del] 2023-11-11 11:55:13,937 DEBUG [Listener at localhost/39241] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:13,939 DEBUG [Listener at localhost/39241] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111510389692eb54d5e803b9c28b14f9afd_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111510389692eb54d5e803b9c28b14f9afd_del 2023-11-11 11:55:13,939 INFO [Listener at localhost/39241] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-11 11:55:13,939 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111723a17ece5ba4c679ae8044d4a2633e8_del] 2023-11-11 11:55:13,940 DEBUG [Listener at localhost/39241] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:13,941 DEBUG [Listener at localhost/39241] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111723a17ece5ba4c679ae8044d4a2633e8_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231111723a17ece5ba4c679ae8044d4a2633e8_del 2023-11-11 11:55:13,941 INFO [Listener at localhost/39241] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-11 11:55:13,944 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:13,947 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:13,951 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:13,952 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:13,960 INFO [Listener at localhost/39241] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-11 11:55:13,960 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-11 11:55:13,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-11 11:55:13,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-11 11:55:13,963 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703713963"}]},"ts":"1699703713963"} 2023-11-11 11:55:13,965 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-11 11:55:13,968 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-11 11:55:13,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=99dc75f3ad72a9db7000d7e9e3c61b9e, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=998271c54a88643806fe1b6c1978d34b, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=be5c328b64d96b557d201a387d04fa34, UNASSIGN}] 2023-11-11 11:55:13,970 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=be5c328b64d96b557d201a387d04fa34, UNASSIGN 2023-11-11 11:55:13,970 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=998271c54a88643806fe1b6c1978d34b, UNASSIGN 2023-11-11 11:55:13,970 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=99dc75f3ad72a9db7000d7e9e3c61b9e, UNASSIGN 2023-11-11 11:55:13,971 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=be5c328b64d96b557d201a387d04fa34, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:13,971 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=99dc75f3ad72a9db7000d7e9e3c61b9e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:13,971 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703713971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703713971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703713971"}]},"ts":"1699703713971"} 2023-11-11 11:55:13,971 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703713971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703713971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703713971"}]},"ts":"1699703713971"} 2023-11-11 11:55:13,972 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=998271c54a88643806fe1b6c1978d34b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:13,972 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703713972"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703713972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703713972"}]},"ts":"1699703713972"} 2023-11-11 11:55:13,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure be5c328b64d96b557d201a387d04fa34, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:55:13,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 99dc75f3ad72a9db7000d7e9e3c61b9e, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:55:13,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure 998271c54a88643806fe1b6c1978d34b, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:55:14,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-11 11:55:14,122 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,41363,1699703601801, timeout=1699703714125, delay=3, operations=[pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure be5c328b64d96b557d201a387d04fa34, server=jenkins-hbase4.apache.org,41363,1699703601801, pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure 998271c54a88643806fe1b6c1978d34b, server=jenkins-hbase4.apache.org,41363,1699703601801, pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 99dc75f3ad72a9db7000d7e9e3c61b9e, server=jenkins-hbase4.apache.org,41363,1699703601801]] 2023-11-11 11:55:14,126 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:14,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close be5c328b64d96b557d201a387d04fa34 2023-11-11 11:55:14,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing be5c328b64d96b557d201a387d04fa34, disabling compactions & flushes 2023-11-11 11:55:14,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:14,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:14,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. after waiting 0 ms 2023-11-11 11:55:14,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:14,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-11 11:55:14,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:14,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:55:14,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed be5c328b64d96b557d201a387d04fa34 2023-11-11 11:55:14,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:55:14,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 998271c54a88643806fe1b6c1978d34b, disabling compactions & flushes 2023-11-11 11:55:14,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:14,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:14,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. after waiting 0 ms 2023-11-11 11:55:14,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:14,134 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=be5c328b64d96b557d201a387d04fa34, regionState=CLOSED 2023-11-11 11:55:14,134 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703714134"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703714134"}]},"ts":"1699703714134"} 2023-11-11 11:55:14,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=91 2023-11-11 11:55:14,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure be5c328b64d96b557d201a387d04fa34, server=jenkins-hbase4.apache.org,41363,1699703601801 in 162 msec 2023-11-11 11:55:14,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-11 11:55:14,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=be5c328b64d96b557d201a387d04fa34, UNASSIGN in 169 msec 2023-11-11 11:55:14,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:14,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:55:14,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:55:14,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:55:14,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 99dc75f3ad72a9db7000d7e9e3c61b9e, disabling compactions & flushes 2023-11-11 11:55:14,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:14,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:14,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. after waiting 0 ms 2023-11-11 11:55:14,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:14,140 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=998271c54a88643806fe1b6c1978d34b, regionState=CLOSED 2023-11-11 11:55:14,140 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703714140"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703714140"}]},"ts":"1699703714140"} 2023-11-11 11:55:14,142 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=90 2023-11-11 11:55:14,142 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure 998271c54a88643806fe1b6c1978d34b, server=jenkins-hbase4.apache.org,41363,1699703601801 in 167 msec 2023-11-11 11:55:14,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=998271c54a88643806fe1b6c1978d34b, UNASSIGN in 174 msec 2023-11-11 11:55:14,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-11 11:55:14,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:14,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:55:14,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:55:14,146 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=99dc75f3ad72a9db7000d7e9e3c61b9e, regionState=CLOSED 2023-11-11 11:55:14,146 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703714146"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703714146"}]},"ts":"1699703714146"} 2023-11-11 11:55:14,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=89 2023-11-11 11:55:14,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 99dc75f3ad72a9db7000d7e9e3c61b9e, server=jenkins-hbase4.apache.org,41363,1699703601801 in 174 msec 2023-11-11 11:55:14,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=89, resume processing ppid=88 2023-11-11 11:55:14,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=99dc75f3ad72a9db7000d7e9e3c61b9e, UNASSIGN in 180 msec 2023-11-11 11:55:14,149 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703714149"}]},"ts":"1699703714149"} 2023-11-11 11:55:14,150 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-11 11:55:14,152 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-11 11:55:14,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 192 msec 2023-11-11 11:55:14,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-11 11:55:14,265 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-11 11:55:14,276 INFO [Listener at localhost/39241] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1699703701885-1699703714276 2023-11-11 11:55:14,276 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 11:55:14,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699703714277 (current time:1699703714277). 2023-11-11 11:55:14,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-11 11:55:14,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] zookeeper.ReadOnlyZKClient(139): Connect 0x5cd0dd16 to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:55:14,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d487c87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:55:14,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:55:14,285 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:55:14,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cd0dd16 to 127.0.0.1:59344 2023-11-11 11:55:14,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:55:14,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-11 11:55:14,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 11:55:14,289 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot, current working dir path: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699703701885-1699703714276 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-11 11:55:14,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-11 11:55:14,292 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-11 11:55:14,292 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699704314292 2023-11-11 11:55:14,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 11:55:14,292 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1699703701885-1699703714276 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-11 11:55:14,293 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:14,293 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-11 11:55:14,393 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 11:55:14,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 11:55:14,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 11:55:14,394 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-11 11:55:14,594 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 11:55:14,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 11:55:14,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 11:55:14,595 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-11 11:55:14,708 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-11 11:55:14,712 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-11 11:55:14,712 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-11 11:55:14,712 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-11 11:55:14,712 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-11 11:55:14,713 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-11 11:55:14,713 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-11 11:55:14,713 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-11 11:55:14,713 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-11 11:55:14,721 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/cff57e2b974a432c9cb5d405422f22db_SeqId_29_, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/e01adc6a9d554afeab2c283a90116f5c] hfiles 2023-11-11 11:55:14,721 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/cff57e2b974a432c9cb5d405422f22db_SeqId_29_ 2023-11-11 11:55:14,721 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/e01adc6a9d554afeab2c283a90116f5c 2023-11-11 11:55:14,721 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111443abcbff0d74ee9802320d0b79c5a9c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111152558ae79c6142088b8a33fdf70eb1a0, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111117ed95571ea7429b90dbae9d437a621d] hfiles 2023-11-11 11:55:14,721 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111443abcbff0d74ee9802320d0b79c5a9c 2023-11-11 11:55:14,722 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/eb881992324b4690932e4651fe9d1d53] hfiles 2023-11-11 11:55:14,722 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111152558ae79c6142088b8a33fdf70eb1a0 2023-11-11 11:55:14,722 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/eb881992324b4690932e4651fe9d1d53 2023-11-11 11:55:14,723 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111117ed95571ea7429b90dbae9d437a621d 2023-11-11 11:55:14,724 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/2fd4f1234c21430994d46552aa832dc6_SeqId_29_, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/de58baf94f0843c8880f522fb8140a4b] hfiles 2023-11-11 11:55:14,724 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/2fd4f1234c21430994d46552aa832dc6_SeqId_29_ 2023-11-11 11:55:14,724 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/de58baf94f0843c8880f522fb8140a4b 2023-11-11 11:55:14,725 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/453e70062391478c97e1383a6731dc24_SeqId_29_, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/78dc8454749e4a64a103c5d80a04ce50] hfiles 2023-11-11 11:55:14,725 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/453e70062391478c97e1383a6731dc24_SeqId_29_ 2023-11-11 11:55:14,725 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/78dc8454749e4a64a103c5d80a04ce50 2023-11-11 11:55:14,726 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/85d312078428409bb8fd987d6233d7ba] hfiles 2023-11-11 11:55:14,726 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/85d312078428409bb8fd987d6233d7ba 2023-11-11 11:55:14,726 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/611a5993d46e4417b145c8053f959c2b] hfiles 2023-11-11 11:55:14,727 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/611a5993d46e4417b145c8053f959c2b 2023-11-11 11:55:14,731 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111137e9fe82b284a3ab6803d13e47385cc, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311111c32ac5521894ab98daaed0051f408f6, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311112b79e4b815d54327bbfdbdb02d0fc48b_del, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111b874607a401d491a90123d43ae228a9a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111e30fd8eda05240579841f2990ac51c60, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311113ebe7da4949847d4ab1bfbcb02b87137, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111610e10038e014205927e397fc998f6bd, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111186844b5641d841c98eed4a8dcdd93eed, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111b06f1067a20242beba4ae0c7e2747a4d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111c4403cc3ccf5454a80d620ee220029df_del, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111102f9b3368c3243d386bb3a3f42ab2ab7, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111442f29961b20439ab732e455b9b851ae, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311116fdaab1943794f2aa420188aa132ab06, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111c8a08260f649405594debdcc95d729cf, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111f352fd9f0d434101bb06ff17984c8d0a_del] hfiles 2023-11-11 11:55:14,731 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111137e9fe82b284a3ab6803d13e47385cc 2023-11-11 11:55:14,731 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311111c32ac5521894ab98daaed0051f408f6 2023-11-11 11:55:14,731 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311112b79e4b815d54327bbfdbdb02d0fc48b_del 2023-11-11 11:55:14,731 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111b874607a401d491a90123d43ae228a9a 2023-11-11 11:55:14,731 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231111e30fd8eda05240579841f2990ac51c60 2023-11-11 11:55:14,731 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311113ebe7da4949847d4ab1bfbcb02b87137 2023-11-11 11:55:14,731 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111610e10038e014205927e397fc998f6bd 2023-11-11 11:55:14,731 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111186844b5641d841c98eed4a8dcdd93eed 2023-11-11 11:55:14,731 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111b06f1067a20242beba4ae0c7e2747a4d 2023-11-11 11:55:14,732 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111c4403cc3ccf5454a80d620ee220029df_del 2023-11-11 11:55:14,732 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111102f9b3368c3243d386bb3a3f42ab2ab7 2023-11-11 11:55:14,732 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111442f29961b20439ab732e455b9b851ae 2023-11-11 11:55:14,732 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311116fdaab1943794f2aa420188aa132ab06 2023-11-11 11:55:14,732 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111c8a08260f649405594debdcc95d729cf 2023-11-11 11:55:14,732 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111f352fd9f0d434101bb06ff17984c8d0a_del 2023-11-11 11:55:14,896 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 11:55:14,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 11:55:14,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 11:55:14,897 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-11 11:55:15,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-11 11:55:15,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1699703701885-1699703714276 2023-11-11 11:55:15,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699703701885-1699703714276 2023-11-11 11:55:15,397 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 11:55:15,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 11:55:15,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-11 11:55:15,399 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-11 11:55:15,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699703701885-1699703714276 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot/hbase-failsafe-snaptb-1699703701885-1699703714276 2023-11-11 11:55:15,614 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1699703701885-1699703714276 of table testCompactionWithHFileLink completed 2023-11-11 11:55:15,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699703701885-1699703714276 2023-11-11 11:55:15,614 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699703701885-1699703714276 2023-11-11 11:55:15,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1699703701885-1699703714276 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699703714292Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1699703714708 (+416 ms)Consolidate snapshot: hbase-failsafe-snaptb-1699703701885-1699703714276 at 1699703715154 (+446 ms)Loading Region manifests for hbase-failsafe-snaptb-1699703701885-1699703714276 at 1699703715154Writing data manifest for hbase-failsafe-snaptb-1699703701885-1699703714276 at 1699703715163 (+9 ms)Verifying snapshot: hbase-failsafe-snaptb-1699703701885-1699703714276 at 1699703715577 (+414 ms)Snapshot hbase-failsafe-snaptb-1699703701885-1699703714276 of table testCompactionWithHFileLink completed at 1699703715614 (+37 ms) 2023-11-11 11:55:15,616 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-11 11:55:15,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.3260 sec 2023-11-11 11:55:16,399 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-11 11:55:16,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-11 11:55:16,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1699703701885-1699703714276 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-11 11:55:16,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699703701885" table: "testCompactionWithHFileLink" creation_time: 1699703701899 type: FLUSH version: 2 ttl: 0 ) 2023-11-11 11:55:16,451 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1699703701885 as table=testCompactionWithHFileLink 2023-11-11 11:55:16,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-11 11:55:16,461 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-11 11:55:16,462 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-11 11:55:16,462 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-11 11:55:16,462 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-11 11:55:16,467 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1699703701885" table: "testCompactionWithHFileLink" creation_time: 1699703701899 type: FLUSH version: 2 ttl: 0 2023-11-11 11:55:16,468 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink 2023-11-11 11:55:16,473 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-11 11:55:16,476 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111443abcbff0d74ee9802320d0b79c5a9c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231111443abcbff0d74ee9802320d0b79c5a9c 2023-11-11 11:55:16,477 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111152558ae79c6142088b8a33fdf70eb1a0 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111152558ae79c6142088b8a33fdf70eb1a0 2023-11-11 11:55:16,478 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111117ed95571ea7429b90dbae9d437a621d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111117ed95571ea7429b90dbae9d437a621d 2023-11-11 11:55:16,479 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023111112e576b4953241308f43e1d7537caea7 of snapshot=snaptb-1699703701885 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 11:55:16,482 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231111268f2ac8d9e44280bb779f3386228ee7 of snapshot=snaptb-1699703701885 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 11:55:16,485 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311113d083de89f244dc1b8f891700d4b02f1 of snapshot=snaptb-1699703701885 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 11:55:16,488 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023111159ecc0e08f924e72aeec52ae71eb9868 of snapshot=snaptb-1699703701885 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 11:55:16,492 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311114bc9a91b07384b3e8fda78dd5d92b84f of snapshot=snaptb-1699703701885 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 11:55:16,496 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023111157b7dfde3a9f4e289de14ae640c58280 of snapshot=snaptb-1699703701885 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 11:55:16,500 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231111d4e4d1956a6741ec803d37d6811a57bd of snapshot=snaptb-1699703701885 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 11:55:16,503 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231111ed8985c28253472e8914a574c2a5f459 of snapshot=snaptb-1699703701885 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 11:55:16,507 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311110f5a6e6593d040c48d839f16db759c68 of snapshot=snaptb-1699703701885 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 11:55:16,510 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311115ace58c02409485aa644851bced3e1d8 of snapshot=snaptb-1699703701885 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 11:55:16,513 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231111d2a9790abffe4d8eb6cec085a7d80c30 of snapshot=snaptb-1699703701885 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 11:55:16,520 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231111dbbb4786da604d108b924c71130c6610 of snapshot=snaptb-1699703701885 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-11 11:55:16,525 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311112b79e4b815d54327bbfdbdb02d0fc48b_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311112b79e4b815d54327bbfdbdb02d0fc48b_del 2023-11-11 11:55:16,526 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111c4403cc3ccf5454a80d620ee220029df_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231111c4403cc3ccf5454a80d620ee220029df_del 2023-11-11 11:55:16,527 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111f352fd9f0d434101bb06ff17984c8d0a_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231111f352fd9f0d434101bb06ff17984c8d0a_del 2023-11-11 11:55:16,527 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:55:16,528 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:55:16,528 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: be5c328b64d96b557d201a387d04fa34 2023-11-11 11:55:16,532 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/e01adc6a9d554afeab2c283a90116f5c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/e01adc6a9d554afeab2c283a90116f5c 2023-11-11 11:55:16,532 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/2fd4f1234c21430994d46552aa832dc6_SeqId_29_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/2fd4f1234c21430994d46552aa832dc6_SeqId_29_ 2023-11-11 11:55:16,532 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/453e70062391478c97e1383a6731dc24_SeqId_29_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/453e70062391478c97e1383a6731dc24_SeqId_29_ 2023-11-11 11:55:16,534 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/cff57e2b974a432c9cb5d405422f22db_SeqId_29_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/cff57e2b974a432c9cb5d405422f22db_SeqId_29_ 2023-11-11 11:55:16,534 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3738921820ab429a8b72082afee389a5 of snapshot=snaptb-1699703701885 to region=998271c54a88643806fe1b6c1978d34b table=testCompactionWithHFileLink 2023-11-11 11:55:16,534 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/78dc8454749e4a64a103c5d80a04ce50 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/78dc8454749e4a64a103c5d80a04ce50 2023-11-11 11:55:16,534 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6da56152861b4113921b3ffe3773b558 of snapshot=snaptb-1699703701885 to region=99dc75f3ad72a9db7000d7e9e3c61b9e table=testCompactionWithHFileLink 2023-11-11 11:55:16,534 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/de58baf94f0843c8880f522fb8140a4b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/de58baf94f0843c8880f522fb8140a4b 2023-11-11 11:55:16,534 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bd9a2401a2a04526ab71e7964c181ab8 of snapshot=snaptb-1699703701885 to region=be5c328b64d96b557d201a387d04fa34 table=testCompactionWithHFileLink 2023-11-11 11:55:16,540 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 825c734d3648470ea46c9a8cd735e032 of snapshot=snaptb-1699703701885 to region=be5c328b64d96b557d201a387d04fa34 table=testCompactionWithHFileLink 2023-11-11 11:55:16,541 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 29873cbdec4f487989fa6b226e794508 of snapshot=snaptb-1699703701885 to region=99dc75f3ad72a9db7000d7e9e3c61b9e table=testCompactionWithHFileLink 2023-11-11 11:55:16,548 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 146911079b654a03a6e1e419f77709e2 of snapshot=snaptb-1699703701885 to region=998271c54a88643806fe1b6c1978d34b table=testCompactionWithHFileLink 2023-11-11 11:55:16,553 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bc013f1514074b72ab7fa367944ae56a of snapshot=snaptb-1699703701885 to region=be5c328b64d96b557d201a387d04fa34 table=testCompactionWithHFileLink 2023-11-11 11:55:16,553 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3059bb60a40d4f58b0f5c16a2a538640 of snapshot=snaptb-1699703701885 to region=99dc75f3ad72a9db7000d7e9e3c61b9e table=testCompactionWithHFileLink 2023-11-11 11:55:16,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-11 11:55:16,555 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 18a5d622f2584a7aa1d534a3afdd65f8 of snapshot=snaptb-1699703701885 to region=998271c54a88643806fe1b6c1978d34b table=testCompactionWithHFileLink 2023-11-11 11:55:16,557 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b2369b2c714d4f13aca25549fa4b665a of snapshot=snaptb-1699703701885 to region=be5c328b64d96b557d201a387d04fa34 table=testCompactionWithHFileLink 2023-11-11 11:55:16,557 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1fe03666af6842f8894e4837158d0d30 of snapshot=snaptb-1699703701885 to region=99dc75f3ad72a9db7000d7e9e3c61b9e table=testCompactionWithHFileLink 2023-11-11 11:55:16,560 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 10793340a817439e8690a88c1372b2d8 of snapshot=snaptb-1699703701885 to region=998271c54a88643806fe1b6c1978d34b table=testCompactionWithHFileLink 2023-11-11 11:55:16,563 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/611a5993d46e4417b145c8053f959c2b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/611a5993d46e4417b145c8053f959c2b 2023-11-11 11:55:16,564 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ca6ba7ef50234eea9235094f18b4172b of snapshot=snaptb-1699703701885 to region=99dc75f3ad72a9db7000d7e9e3c61b9e table=testCompactionWithHFileLink 2023-11-11 11:55:16,564 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/85d312078428409bb8fd987d6233d7ba to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/85d312078428409bb8fd987d6233d7ba 2023-11-11 11:55:16,564 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f413166c047243caaea4d6a006096d73 of snapshot=snaptb-1699703701885 to region=be5c328b64d96b557d201a387d04fa34 table=testCompactionWithHFileLink 2023-11-11 11:55:16,566 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/eb881992324b4690932e4651fe9d1d53 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/eb881992324b4690932e4651fe9d1d53 2023-11-11 11:55:16,566 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d136474a81d94d1e9a20a83d42568946 of snapshot=snaptb-1699703701885 to region=998271c54a88643806fe1b6c1978d34b table=testCompactionWithHFileLink 2023-11-11 11:55:16,568 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d5657159438b4fbca63c754f39f2182c of snapshot=snaptb-1699703701885 to region=99dc75f3ad72a9db7000d7e9e3c61b9e table=testCompactionWithHFileLink 2023-11-11 11:55:16,569 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink af9aad0939ef4556ab0757d47af29d98 of snapshot=snaptb-1699703701885 to region=be5c328b64d96b557d201a387d04fa34 table=testCompactionWithHFileLink 2023-11-11 11:55:16,571 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink aa9650f16fef4fb2a0e814af62aa97d4 of snapshot=snaptb-1699703701885 to region=998271c54a88643806fe1b6c1978d34b table=testCompactionWithHFileLink 2023-11-11 11:55:16,572 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8d5bc1c6ebe64c079b3099ada0941e2c of snapshot=snaptb-1699703701885 to region=99dc75f3ad72a9db7000d7e9e3c61b9e table=testCompactionWithHFileLink 2023-11-11 11:55:16,573 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9d9bfccacf39439892dc83099a14166c of snapshot=snaptb-1699703701885 to region=be5c328b64d96b557d201a387d04fa34 table=testCompactionWithHFileLink 2023-11-11 11:55:16,583 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ab0d303fc8d74594a2b4e500f523eaaf of snapshot=snaptb-1699703701885 to region=998271c54a88643806fe1b6c1978d34b table=testCompactionWithHFileLink 2023-11-11 11:55:16,585 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 79ad1493231d4d57ae1032371fed9f97 of snapshot=snaptb-1699703701885 to region=99dc75f3ad72a9db7000d7e9e3c61b9e table=testCompactionWithHFileLink 2023-11-11 11:55:16,585 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 95cd2b2fb9d44b518c882621b5178950 of snapshot=snaptb-1699703701885 to region=be5c328b64d96b557d201a387d04fa34 table=testCompactionWithHFileLink 2023-11-11 11:55:16,587 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8eada10ab82b4f0da7a7cdaab690121c of snapshot=snaptb-1699703701885 to region=998271c54a88643806fe1b6c1978d34b table=testCompactionWithHFileLink 2023-11-11 11:55:16,597 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1699703701885" table: "testCompactionWithHFileLink" creation_time: 1699703701899 type: FLUSH version: 2 ttl: 0 2023-11-11 11:55:16,598 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699703716598"}]},"ts":"9223372036854775807"} 2023-11-11 11:55:16,599 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699703716598"}]},"ts":"9223372036854775807"} 2023-11-11 11:55:16,599 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699703716598"}]},"ts":"9223372036854775807"} 2023-11-11 11:55:16,600 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-11 11:55:16,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 998271c54a88643806fe1b6c1978d34b, NAME => 'testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 99dc75f3ad72a9db7000d7e9e3c61b9e, NAME => 'testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => be5c328b64d96b557d201a387d04fa34, NAME => 'testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.', STARTKEY => '2', ENDKEY => ''}] 2023-11-11 11:55:16,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703716599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703716599"}]},"ts":"1699703716599"} 2023-11-11 11:55:16,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703716599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703716599"}]},"ts":"1699703716599"} 2023-11-11 11:55:16,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703716599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703716599"}]},"ts":"1699703716599"} 2023-11-11 11:55:16,602 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-11 11:55:16,602 INFO [PEWorker-1] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-11 11:55:16,602 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 998271c54a88643806fe1b6c1978d34b, NAME => 'testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 99dc75f3ad72a9db7000d7e9e3c61b9e, NAME => 'testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => be5c328b64d96b557d201a387d04fa34, NAME => 'testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.', STARTKEY => '2', ENDKEY => ''}] 2023-11-11 11:55:16,603 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1699703701885 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-11 11:55:16,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699703701885" table: "testCompactionWithHFileLink" creation_time: 1699703701899 type: FLUSH version: 2 ttl: 0 ) in 165 msec 2023-11-11 11:55:16,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-11 11:55:16,757 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-11 11:55:16,757 INFO [Listener at localhost/39241] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1699703701885-1699703714276 2023-11-11 11:55:16,761 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1699703701885-1699703714276" 2023-11-11 11:55:16,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1699703701885-1699703714276 2023-11-11 11:55:16,766 INFO [Listener at localhost/39241] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-11 11:55:16,770 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-11 11:55:16,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-11 11:55:16,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-11 11:55:16,779 INFO [PEWorker-4] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-11 11:55:16,779 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703716779"}]},"ts":"1699703716779"} 2023-11-11 11:55:16,780 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-11 11:55:16,783 DEBUG [PEWorker-4] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-11 11:55:16,783 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=99dc75f3ad72a9db7000d7e9e3c61b9e, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=998271c54a88643806fe1b6c1978d34b, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=be5c328b64d96b557d201a387d04fa34, ASSIGN}] 2023-11-11 11:55:16,784 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=998271c54a88643806fe1b6c1978d34b, ASSIGN 2023-11-11 11:55:16,784 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=99dc75f3ad72a9db7000d7e9e3c61b9e, ASSIGN 2023-11-11 11:55:16,785 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=be5c328b64d96b557d201a387d04fa34, ASSIGN 2023-11-11 11:55:16,785 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=998271c54a88643806fe1b6c1978d34b, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-11 11:55:16,785 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=99dc75f3ad72a9db7000d7e9e3c61b9e, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-11 11:55:16,785 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=be5c328b64d96b557d201a387d04fa34, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-11 11:55:16,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-11 11:55:16,937 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=99dc75f3ad72a9db7000d7e9e3c61b9e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:16,938 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703716937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703716937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703716937"}]},"ts":"1699703716937"} 2023-11-11 11:55:16,937 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=be5c328b64d96b557d201a387d04fa34, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:16,939 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703716937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703716937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703716937"}]},"ts":"1699703716937"} 2023-11-11 11:55:16,937 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=998271c54a88643806fe1b6c1978d34b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:16,939 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703716937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703716937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703716937"}]},"ts":"1699703716937"} 2023-11-11 11:55:16,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure 99dc75f3ad72a9db7000d7e9e3c61b9e, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:55:16,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure be5c328b64d96b557d201a387d04fa34, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:55:16,942 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure 998271c54a88643806fe1b6c1978d34b, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:55:17,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-11 11:55:17,093 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:17,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 99dc75f3ad72a9db7000d7e9e3c61b9e, NAME => 'testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.', STARTKEY => '', ENDKEY => '1'} 2023-11-11 11:55:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:55:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:55:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:55:17,097 INFO [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:55:17,098 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1 2023-11-11 11:55:17,098 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1 2023-11-11 11:55:17,099 INFO [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99dc75f3ad72a9db7000d7e9e3c61b9e columnFamilyName family1 2023-11-11 11:55:17,108 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-1fe03666af6842f8894e4837158d0d30 2023-11-11 11:55:17,114 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-29873cbdec4f487989fa6b226e794508 2023-11-11 11:55:17,119 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-3059bb60a40d4f58b0f5c16a2a538640 2023-11-11 11:55:17,123 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-6da56152861b4113921b3ffe3773b558 2023-11-11 11:55:17,124 INFO [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(310): Store=99dc75f3ad72a9db7000d7e9e3c61b9e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:17,124 INFO [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:55:17,125 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2 2023-11-11 11:55:17,125 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2 2023-11-11 11:55:17,125 INFO [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99dc75f3ad72a9db7000d7e9e3c61b9e columnFamilyName family2 2023-11-11 11:55:17,131 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-79ad1493231d4d57ae1032371fed9f97 2023-11-11 11:55:17,135 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-8d5bc1c6ebe64c079b3099ada0941e2c 2023-11-11 11:55:17,140 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-ca6ba7ef50234eea9235094f18b4172b 2023-11-11 11:55:17,145 DEBUG [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-d5657159438b4fbca63c754f39f2182c 2023-11-11 11:55:17,145 INFO [StoreOpener-99dc75f3ad72a9db7000d7e9e3c61b9e-1] regionserver.HStore(310): Store=99dc75f3ad72a9db7000d7e9e3c61b9e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:17,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:55:17,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:55:17,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:55:17,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:55:17,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 99dc75f3ad72a9db7000d7e9e3c61b9e; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73235658, jitterRate=0.09129634499549866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:55:17,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:55:17,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e., pid=101, masterSystemTime=1699703717093 2023-11-11 11:55:17,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:55:17,152 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-11 11:55:17,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-11 11:55:17,152 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-11 11:55:17,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:17,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:17,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:17,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be5c328b64d96b557d201a387d04fa34, NAME => 'testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.', STARTKEY => '2', ENDKEY => ''} 2023-11-11 11:55:17,154 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=99dc75f3ad72a9db7000d7e9e3c61b9e, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:17,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink be5c328b64d96b557d201a387d04fa34 2023-11-11 11:55:17,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:17,154 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703717154"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703717154"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703717154"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703717154"}]},"ts":"1699703717154"} 2023-11-11 11:55:17,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for be5c328b64d96b557d201a387d04fa34 2023-11-11 11:55:17,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for be5c328b64d96b557d201a387d04fa34 2023-11-11 11:55:17,156 INFO [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region be5c328b64d96b557d201a387d04fa34 2023-11-11 11:55:17,157 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-11 11:55:17,157 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HStore(1912): 99dc75f3ad72a9db7000d7e9e3c61b9e/family2 is initiating minor compaction (all files) 2023-11-11 11:55:17,157 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 99dc75f3ad72a9db7000d7e9e3c61b9e/family2 in testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:17,157 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-ca6ba7ef50234eea9235094f18b4172b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-d5657159438b4fbca63c754f39f2182c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-8d5bc1c6ebe64c079b3099ada0941e2c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-79ad1493231d4d57ae1032371fed9f97] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp, totalSize=20.4 K 2023-11-11 11:55:17,158 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-11 11:55:17,158 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1 2023-11-11 11:55:17,158 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1 2023-11-11 11:55:17,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=98 2023-11-11 11:55:17,158 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-ca6ba7ef50234eea9235094f18b4172b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703695070 2023-11-11 11:55:17,158 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1912): 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 is initiating minor compaction (all files) 2023-11-11 11:55:17,159 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 in testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:55:17,159 INFO [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be5c328b64d96b557d201a387d04fa34 columnFamilyName family1 2023-11-11 11:55:17,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure 99dc75f3ad72a9db7000d7e9e3c61b9e, server=jenkins-hbase4.apache.org,41363,1699703601801 in 216 msec 2023-11-11 11:55:17,159 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-6da56152861b4113921b3ffe3773b558, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-29873cbdec4f487989fa6b226e794508, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-3059bb60a40d4f58b0f5c16a2a538640, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-1fe03666af6842f8894e4837158d0d30] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp, totalSize=21.6 K 2023-11-11 11:55:17,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=99dc75f3ad72a9db7000d7e9e3c61b9e, ASSIGN in 375 msec 2023-11-11 11:55:17,160 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-d5657159438b4fbca63c754f39f2182c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703696862 2023-11-11 11:55:17,161 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-6da56152861b4113921b3ffe3773b558, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703695070 2023-11-11 11:55:17,161 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-8d5bc1c6ebe64c079b3099ada0941e2c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703698278 2023-11-11 11:55:17,162 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-29873cbdec4f487989fa6b226e794508, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703696862 2023-11-11 11:55:17,162 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-79ad1493231d4d57ae1032371fed9f97, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703700097 2023-11-11 11:55:17,163 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-3059bb60a40d4f58b0f5c16a2a538640, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703698278 2023-11-11 11:55:17,167 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-1fe03666af6842f8894e4837158d0d30, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703700097 2023-11-11 11:55:17,173 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-825c734d3648470ea46c9a8cd735e032 2023-11-11 11:55:17,187 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-b2369b2c714d4f13aca25549fa4b665a 2023-11-11 11:55:17,203 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-bc013f1514074b72ab7fa367944ae56a 2023-11-11 11:55:17,205 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] throttle.PressureAwareThroughputController(145): 99dc75f3ad72a9db7000d7e9e3c61b9e#family2#compaction#113 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-11 11:55:17,220 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-bd9a2401a2a04526ab71e7964c181ab8 2023-11-11 11:55:17,221 INFO [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(310): Store=be5c328b64d96b557d201a387d04fa34/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:17,221 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): 99dc75f3ad72a9db7000d7e9e3c61b9e#family1#compaction#114 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-11 11:55:17,221 INFO [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region be5c328b64d96b557d201a387d04fa34 2023-11-11 11:55:17,222 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2 2023-11-11 11:55:17,223 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2 2023-11-11 11:55:17,223 INFO [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be5c328b64d96b557d201a387d04fa34 columnFamilyName family2 2023-11-11 11:55:17,235 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-95cd2b2fb9d44b518c882621b5178950 2023-11-11 11:55:17,242 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-9d9bfccacf39439892dc83099a14166c 2023-11-11 11:55:17,246 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-af9aad0939ef4556ab0757d47af29d98 2023-11-11 11:55:17,251 DEBUG [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-f413166c047243caaea4d6a006096d73 2023-11-11 11:55:17,251 INFO [StoreOpener-be5c328b64d96b557d201a387d04fa34-1] regionserver.HStore(310): Store=be5c328b64d96b557d201a387d04fa34/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:17,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34 2023-11-11 11:55:17,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34 2023-11-11 11:55:17,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:55:17,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for be5c328b64d96b557d201a387d04fa34 2023-11-11 11:55:17,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened be5c328b64d96b557d201a387d04fa34; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72073003, jitterRate=0.07397143542766571}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:55:17,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:55:17,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34., pid=102, masterSystemTime=1699703717093 2023-11-11 11:55:17,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-11 11:55:17,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-11 11:55:17,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:17,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:17,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:17,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 998271c54a88643806fe1b6c1978d34b, NAME => 'testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.', STARTKEY => '1', ENDKEY => '2'} 2023-11-11 11:55:17,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:55:17,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:17,258 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=be5c328b64d96b557d201a387d04fa34, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:17,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:55:17,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:55:17,258 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699703717258"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703717258"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703717258"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703717258"}]},"ts":"1699703717258"} 2023-11-11 11:55:17,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-11-11 11:55:17,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure be5c328b64d96b557d201a387d04fa34, server=jenkins-hbase4.apache.org,41363,1699703601801 in 318 msec 2023-11-11 11:55:17,261 INFO [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:55:17,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=be5c328b64d96b557d201a387d04fa34, ASSIGN in 477 msec 2023-11-11 11:55:17,262 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1 2023-11-11 11:55:17,262 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1 2023-11-11 11:55:17,262 INFO [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 998271c54a88643806fe1b6c1978d34b columnFamilyName family1 2023-11-11 11:55:17,271 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-10793340a817439e8690a88c1372b2d8 2023-11-11 11:55:17,277 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-146911079b654a03a6e1e419f77709e2 2023-11-11 11:55:17,283 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-18a5d622f2584a7aa1d534a3afdd65f8 2023-11-11 11:55:17,293 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-3738921820ab429a8b72082afee389a5 2023-11-11 11:55:17,294 INFO [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(310): Store=998271c54a88643806fe1b6c1978d34b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:17,294 INFO [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:55:17,295 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2 2023-11-11 11:55:17,295 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2 2023-11-11 11:55:17,295 INFO [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 998271c54a88643806fe1b6c1978d34b columnFamilyName family2 2023-11-11 11:55:17,301 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-8eada10ab82b4f0da7a7cdaab690121c 2023-11-11 11:55:17,310 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-aa9650f16fef4fb2a0e814af62aa97d4 2023-11-11 11:55:17,316 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-ab0d303fc8d74594a2b4e500f523eaaf 2023-11-11 11:55:17,328 DEBUG [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(539): loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-d136474a81d94d1e9a20a83d42568946 2023-11-11 11:55:17,328 INFO [StoreOpener-998271c54a88643806fe1b6c1978d34b-1] regionserver.HStore(310): Store=998271c54a88643806fe1b6c1978d34b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:17,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b 2023-11-11 11:55:17,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b 2023-11-11 11:55:17,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:55:17,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:55:17,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 998271c54a88643806fe1b6c1978d34b; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63665153, jitterRate=-0.051315292716026306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:55:17,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:55:17,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b., pid=103, masterSystemTime=1699703717093 2023-11-11 11:55:17,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-11 11:55:17,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-11 11:55:17,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:17,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:17,336 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=998271c54a88643806fe1b6c1978d34b, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:17,336 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703717335"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703717335"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703717335"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703717335"}]},"ts":"1699703717335"} 2023-11-11 11:55:17,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=99 2023-11-11 11:55:17,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure 998271c54a88643806fe1b6c1978d34b, server=jenkins-hbase4.apache.org,41363,1699703601801 in 395 msec 2023-11-11 11:55:17,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=99, resume processing ppid=97 2023-11-11 11:55:17,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=998271c54a88643806fe1b6c1978d34b, ASSIGN in 555 msec 2023-11-11 11:55:17,340 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703717340"}]},"ts":"1699703717340"} 2023-11-11 11:55:17,340 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-11 11:55:17,342 INFO [PEWorker-4] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-11 11:55:17,343 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 572 msec 2023-11-11 11:55:17,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-11 11:55:17,382 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-11 11:55:17,396 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:17,404 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:17,412 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:17,413 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:17,419 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-11 11:55:17,432 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-11 11:55:17,432 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:17,433 DEBUG [Listener at localhost/39241] zookeeper.ReadOnlyZKClient(139): Connect 0x37027dbb to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:55:17,437 DEBUG [Listener at localhost/39241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@733a08d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:55:17,437 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 11:55:17,437 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 11:55:17,437 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 11:55:18,038 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family2/b5d2532b6ac944ba95ee1e75a458ad23 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/b5d2532b6ac944ba95ee1e75a458ad23 2023-11-11 11:55:18,043 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 99dc75f3ad72a9db7000d7e9e3c61b9e/family2 of 99dc75f3ad72a9db7000d7e9e3c61b9e into b5d2532b6ac944ba95ee1e75a458ad23(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:55:18,043 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:55:18,043 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e., storeName=99dc75f3ad72a9db7000d7e9e3c61b9e/family2, priority=12, startTime=1699703717152; duration=0sec 2023-11-11 11:55:18,043 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-11 11:55:18,044 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-11 11:55:18,046 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-11 11:55:18,046 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HStore(1912): be5c328b64d96b557d201a387d04fa34/family1 is initiating minor compaction (all files) 2023-11-11 11:55:18,046 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HRegion(2259): Starting compaction of be5c328b64d96b557d201a387d04fa34/family1 in testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:18,046 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-bd9a2401a2a04526ab71e7964c181ab8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-825c734d3648470ea46c9a8cd735e032, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-bc013f1514074b72ab7fa367944ae56a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-b2369b2c714d4f13aca25549fa4b665a] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp, totalSize=21.6 K 2023-11-11 11:55:18,047 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-bd9a2401a2a04526ab71e7964c181ab8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703695072 2023-11-11 11:55:18,048 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-825c734d3648470ea46c9a8cd735e032, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703696863 2023-11-11 11:55:18,049 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-bc013f1514074b72ab7fa367944ae56a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703698278 2023-11-11 11:55:18,049 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-b2369b2c714d4f13aca25549fa4b665a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703700097 2023-11-11 11:55:18,049 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/.tmp/family1/1b77b6b47af547d19fe4dec293b5f3cd as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/1b77b6b47af547d19fe4dec293b5f3cd 2023-11-11 11:55:18,054 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 of 99dc75f3ad72a9db7000d7e9e3c61b9e into 1b77b6b47af547d19fe4dec293b5f3cd(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:55:18,054 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:55:18,054 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e., storeName=99dc75f3ad72a9db7000d7e9e3c61b9e/family1, priority=12, startTime=1699703717152; duration=0sec 2023-11-11 11:55:18,054 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-11 11:55:18,055 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-11 11:55:18,057 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-11 11:55:18,057 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1912): 998271c54a88643806fe1b6c1978d34b/family2 is initiating minor compaction (all files) 2023-11-11 11:55:18,057 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 998271c54a88643806fe1b6c1978d34b/family2 in testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:18,057 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-d136474a81d94d1e9a20a83d42568946, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-aa9650f16fef4fb2a0e814af62aa97d4, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-ab0d303fc8d74594a2b4e500f523eaaf, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-8eada10ab82b4f0da7a7cdaab690121c] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp, totalSize=20.4 K 2023-11-11 11:55:18,057 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-d136474a81d94d1e9a20a83d42568946, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703695071 2023-11-11 11:55:18,058 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-aa9650f16fef4fb2a0e814af62aa97d4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703696863 2023-11-11 11:55:18,059 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-ab0d303fc8d74594a2b4e500f523eaaf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703698278 2023-11-11 11:55:18,059 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-8eada10ab82b4f0da7a7cdaab690121c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703700097 2023-11-11 11:55:18,062 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] throttle.PressureAwareThroughputController(145): be5c328b64d96b557d201a387d04fa34#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-11 11:55:18,065 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-6da56152861b4113921b3ffe3773b558, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-29873cbdec4f487989fa6b226e794508, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-3059bb60a40d4f58b0f5c16a2a538640, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-1fe03666af6842f8894e4837158d0d30] to archive 2023-11-11 11:55:18,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:18,068 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-6da56152861b4113921b3ffe3773b558 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-6da56152861b4113921b3ffe3773b558 2023-11-11 11:55:18,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-29873cbdec4f487989fa6b226e794508 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-29873cbdec4f487989fa6b226e794508 2023-11-11 11:55:18,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-3059bb60a40d4f58b0f5c16a2a538640 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-3059bb60a40d4f58b0f5c16a2a538640 2023-11-11 11:55:18,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-1fe03666af6842f8894e4837158d0d30 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-1fe03666af6842f8894e4837158d0d30 2023-11-11 11:55:18,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-ca6ba7ef50234eea9235094f18b4172b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-d5657159438b4fbca63c754f39f2182c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-8d5bc1c6ebe64c079b3099ada0941e2c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-79ad1493231d4d57ae1032371fed9f97] to archive 2023-11-11 11:55:18,078 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:18,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-ca6ba7ef50234eea9235094f18b4172b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-ca6ba7ef50234eea9235094f18b4172b 2023-11-11 11:55:18,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-d5657159438b4fbca63c754f39f2182c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-d5657159438b4fbca63c754f39f2182c 2023-11-11 11:55:18,082 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): 998271c54a88643806fe1b6c1978d34b#family2#compaction#116 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-11 11:55:18,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-8d5bc1c6ebe64c079b3099ada0941e2c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-8d5bc1c6ebe64c079b3099ada0941e2c 2023-11-11 11:55:18,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-79ad1493231d4d57ae1032371fed9f97 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family2/testCompactionWithHFileLink=99dc75f3ad72a9db7000d7e9e3c61b9e-79ad1493231d4d57ae1032371fed9f97 2023-11-11 11:55:18,313 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311118554274f2623405a982a8b95c85519d4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311118554274f2623405a982a8b95c85519d4 2023-11-11 11:55:18,314 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:18,319 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111198c0a560298f4d76af9ee31940f1172d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111198c0a560298f4d76af9ee31940f1172d 2023-11-11 11:55:18,320 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111101015b1949af4c80acddf3d53e01f340 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111101015b1949af4c80acddf3d53e01f340 2023-11-11 11:55:18,320 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:18,321 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:18,327 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:55:18,331 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:55:18,348 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:55:18,352 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:55:18,371 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/64a404a6d07748af8528c7e2d0c095f5 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-11 11:55:18,373 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=32 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/64a404a6d07748af8528c7e2d0c095f5}] 2023-11-11 11:55:18,379 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/78f18cfe8e7a4fb38695ff76794c0062 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-11 11:55:18,380 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/7fe6eab1700c4bcbbf40c92addf8caf8 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-11 11:55:18,380 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/64a404a6d07748af8528c7e2d0c095f5 for inclusion in 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 2023-11-11 11:55:18,380 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/78f18cfe8e7a4fb38695ff76794c0062}] 2023-11-11 11:55:18,380 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/7fe6eab1700c4bcbbf40c92addf8caf8}] 2023-11-11 11:55:18,382 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/78f18cfe8e7a4fb38695ff76794c0062 for inclusion in 998271c54a88643806fe1b6c1978d34b/family1 2023-11-11 11:55:18,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/7fe6eab1700c4bcbbf40c92addf8caf8 for inclusion in be5c328b64d96b557d201a387d04fa34/family1 2023-11-11 11:55:18,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-11 11:55:18,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last=1 2023-11-11 11:55:18,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:55:18,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111/family1/64a404a6d07748af8528c7e2d0c095f5 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__70becj5979vjp0h00p58ocbm0ve9t3gkh4jh16ee4pfmiu66ihaggpooqii08mas/family1/64a404a6d07748af8528c7e2d0c095f5 2023-11-11 11:55:18,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-11 11:55:18,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-11 11:55:18,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-11 11:55:18,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-11 11:55:18,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:55:18,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:55:18,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111/family1/78f18cfe8e7a4fb38695ff76794c0062 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__vi29c7qeud0dgovbj9pufo573p4a6jpk8lq9bgjnbdgcropjqrnat9q2ncismh9l/family1/78f18cfe8e7a4fb38695ff76794c0062 2023-11-11 11:55:18,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__70becj5979vjp0h00p58ocbm0ve9t3gkh4jh16ee4pfmiu66ihaggpooqii08mas/family1/64a404a6d07748af8528c7e2d0c095f5 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/3e0ee2b41d874d37b99fda94d4013b39_SeqId_36_ 2023-11-11 11:55:18,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111/family1/7fe6eab1700c4bcbbf40c92addf8caf8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__nu01dgb4u4q4ql57eq2q800q47bmfcpg9abql5ucen0qes7r2h6eai70tg94eals/family1/7fe6eab1700c4bcbbf40c92addf8caf8 2023-11-11 11:55:18,389 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__70becj5979vjp0h00p58ocbm0ve9t3gkh4jh16ee4pfmiu66ihaggpooqii08mas/family1/64a404a6d07748af8528c7e2d0c095f5 into 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/3e0ee2b41d874d37b99fda94d4013b39_SeqId_36_ - updating store file list. 2023-11-11 11:55:18,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__vi29c7qeud0dgovbj9pufo573p4a6jpk8lq9bgjnbdgcropjqrnat9q2ncismh9l/family1/78f18cfe8e7a4fb38695ff76794c0062 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/d4c99ca711d84780a0e06c46774cc161_SeqId_34_ 2023-11-11 11:55:18,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__nu01dgb4u4q4ql57eq2q800q47bmfcpg9abql5ucen0qes7r2h6eai70tg94eals/family1/7fe6eab1700c4bcbbf40c92addf8caf8 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/9fbf65cb616e43f4bda98b414762f355_SeqId_34_ 2023-11-11 11:55:18,392 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__vi29c7qeud0dgovbj9pufo573p4a6jpk8lq9bgjnbdgcropjqrnat9q2ncismh9l/family1/78f18cfe8e7a4fb38695ff76794c0062 into 998271c54a88643806fe1b6c1978d34b/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/d4c99ca711d84780a0e06c46774cc161_SeqId_34_ - updating store file list. 2023-11-11 11:55:18,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__nu01dgb4u4q4ql57eq2q800q47bmfcpg9abql5ucen0qes7r2h6eai70tg94eals/family1/7fe6eab1700c4bcbbf40c92addf8caf8 into be5c328b64d96b557d201a387d04fa34/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/9fbf65cb616e43f4bda98b414762f355_SeqId_34_ - updating store file list. 2023-11-11 11:55:18,393 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/3e0ee2b41d874d37b99fda94d4013b39_SeqId_36_ into 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 2023-11-11 11:55:18,393 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__70becj5979vjp0h00p58ocbm0ve9t3gkh4jh16ee4pfmiu66ihaggpooqii08mas/family1/64a404a6d07748af8528c7e2d0c095f5 into 99dc75f3ad72a9db7000d7e9e3c61b9e/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/family1/3e0ee2b41d874d37b99fda94d4013b39_SeqId_36_) 2023-11-11 11:55:18,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__70becj5979vjp0h00p58ocbm0ve9t3gkh4jh16ee4pfmiu66ihaggpooqii08mas/family1/64a404a6d07748af8528c7e2d0c095f5 2023-11-11 11:55:18,396 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/d4c99ca711d84780a0e06c46774cc161_SeqId_34_ into 998271c54a88643806fe1b6c1978d34b/family1 2023-11-11 11:55:18,396 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__vi29c7qeud0dgovbj9pufo573p4a6jpk8lq9bgjnbdgcropjqrnat9q2ncismh9l/family1/78f18cfe8e7a4fb38695ff76794c0062 into 998271c54a88643806fe1b6c1978d34b/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/d4c99ca711d84780a0e06c46774cc161_SeqId_34_) 2023-11-11 11:55:18,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/9fbf65cb616e43f4bda98b414762f355_SeqId_34_ into be5c328b64d96b557d201a387d04fa34/family1 2023-11-11 11:55:18,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__vi29c7qeud0dgovbj9pufo573p4a6jpk8lq9bgjnbdgcropjqrnat9q2ncismh9l/family1/78f18cfe8e7a4fb38695ff76794c0062 2023-11-11 11:55:18,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__nu01dgb4u4q4ql57eq2q800q47bmfcpg9abql5ucen0qes7r2h6eai70tg94eals/family1/7fe6eab1700c4bcbbf40c92addf8caf8 into be5c328b64d96b557d201a387d04fa34/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/9fbf65cb616e43f4bda98b414762f355_SeqId_34_) 2023-11-11 11:55:18,397 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:18,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testCompactionWithHFileLink__nu01dgb4u4q4ql57eq2q800q47bmfcpg9abql5ucen0qes7r2h6eai70tg94eals/family1/7fe6eab1700c4bcbbf40c92addf8caf8 2023-11-11 11:55:18,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:18,398 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:18,400 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311110f5a6e6593d040c48d839f16db759c68 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311110f5a6e6593d040c48d839f16db759c68 2023-11-11 11:55:18,400 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:18,402 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:18,403 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311115ace58c02409485aa644851bced3e1d8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311115ace58c02409485aa644851bced3e1d8 2023-11-11 11:55:18,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-11 11:55:18,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(1912): 998271c54a88643806fe1b6c1978d34b/family1 is initiating minor compaction (all files) 2023-11-11 11:55:18,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4dad7040; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-11 11:55:18,404 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311114bc9a91b07384b3e8fda78dd5d92b84f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311114bc9a91b07384b3e8fda78dd5d92b84f 2023-11-11 11:55:18,404 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231111d2a9790abffe4d8eb6cec085a7d80c30 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231111d2a9790abffe4d8eb6cec085a7d80c30 2023-11-11 11:55:18,405 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023111157b7dfde3a9f4e289de14ae640c58280 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023111157b7dfde3a9f4e289de14ae640c58280 2023-11-11 11:55:18,406 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231111dbbb4786da604d108b924c71130c6610 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231111dbbb4786da604d108b924c71130c6610 2023-11-11 11:55:18,406 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-11 11:55:18,406 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231111' 2023-11-11 11:55:18,407 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:18,407 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231111d4e4d1956a6741ec803d37d6811a57bd to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231111d4e4d1956a6741ec803d37d6811a57bd 2023-11-11 11:55:18,407 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 11:55:18,408 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:18,409 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231111ed8985c28253472e8914a574c2a5f459 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231111ed8985c28253472e8914a574c2a5f459 2023-11-11 11:55:18,409 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-11 11:55:18,409 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231111' 2023-11-11 11:55:18,409 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 11:55:18,410 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111112e576b4953241308f43e1d7537caea7 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111112e576b4953241308f43e1d7537caea7 2023-11-11 11:55:18,411 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231111268f2ac8d9e44280bb779f3386228ee7 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231111268f2ac8d9e44280bb779f3386228ee7 2023-11-11 11:55:18,412 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311113d083de89f244dc1b8f891700d4b02f1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311113d083de89f244dc1b8f891700d4b02f1 2023-11-11 11:55:18,414 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111159ecc0e08f924e72aeec52ae71eb9868 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111159ecc0e08f924e72aeec52ae71eb9868 2023-11-11 11:55:18,414 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-11 11:55:18,414 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231111' 2023-11-11 11:55:18,415 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231111 for table='testCompactionWithHFileLink' and column='family1' 2023-11-11 11:55:18,415 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-11 11:55:18,422 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:18,425 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:18,428 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:18,430 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:18,438 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:18,439 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:18,461 INFO [Listener at localhost/39241] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=285 (was 233) - Thread LEAK? -, OpenFileDescriptor=782 (was 618) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=136 (was 123) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=2301 (was 2045) - AvailableMemoryMB LEAK? - 2023-11-11 11:55:18,477 INFO [Listener at localhost/39241] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=285, OpenFileDescriptor=782, MaxFileDescriptor=60000, SystemLoadAverage=136, ProcessCount=170, AvailableMemoryMB=2300 2023-11-11 11:55:18,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-11 11:55:18,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-11 11:55:18,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-11 11:55:18,492 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family1/12389d13cd694fc58cf9b832f13c119f as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/12389d13cd694fc58cf9b832f13c119f 2023-11-11 11:55:18,494 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-11 11:55:18,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 11 msec 2023-11-11 11:55:18,498 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in be5c328b64d96b557d201a387d04fa34/family1 of be5c328b64d96b557d201a387d04fa34 into 12389d13cd694fc58cf9b832f13c119f(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:55:18,498 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:55:18,498 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34., storeName=be5c328b64d96b557d201a387d04fa34/family1, priority=12, startTime=1699703717256; duration=0sec 2023-11-11 11:55:18,498 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-11 11:55:18,498 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 998271c54a88643806fe1b6c1978d34b/family1 in testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:55:18,498 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-3738921820ab429a8b72082afee389a5, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-146911079b654a03a6e1e419f77709e2, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-18a5d622f2584a7aa1d534a3afdd65f8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-10793340a817439e8690a88c1372b2d8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/d4c99ca711d84780a0e06c46774cc161_SeqId_34_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp, totalSize=28.9 K 2023-11-11 11:55:18,499 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-3738921820ab429a8b72082afee389a5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703695071 2023-11-11 11:55:18,500 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-146911079b654a03a6e1e419f77709e2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703696863 2023-11-11 11:55:18,500 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-18a5d622f2584a7aa1d534a3afdd65f8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703698278 2023-11-11 11:55:18,501 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-10793340a817439e8690a88c1372b2d8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703700097 2023-11-11 11:55:18,501 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] compactions.Compactor(207): Compacting d4c99ca711d84780a0e06c46774cc161_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1699703695071 2023-11-11 11:55:18,513 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] throttle.PressureAwareThroughputController(145): 998271c54a88643806fe1b6c1978d34b#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-11 11:55:18,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-bd9a2401a2a04526ab71e7964c181ab8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-825c734d3648470ea46c9a8cd735e032, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-bc013f1514074b72ab7fa367944ae56a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-b2369b2c714d4f13aca25549fa4b665a] to archive 2023-11-11 11:55:18,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:18,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-bd9a2401a2a04526ab71e7964c181ab8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-bd9a2401a2a04526ab71e7964c181ab8 2023-11-11 11:55:18,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-825c734d3648470ea46c9a8cd735e032 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-825c734d3648470ea46c9a8cd735e032 2023-11-11 11:55:18,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-bc013f1514074b72ab7fa367944ae56a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-bc013f1514074b72ab7fa367944ae56a 2023-11-11 11:55:18,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-b2369b2c714d4f13aca25549fa4b665a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family1/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-b2369b2c714d4f13aca25549fa4b665a 2023-11-11 11:55:18,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-11 11:55:18,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-11 11:55:18,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-11 11:55:18,597 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 11:55:18,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-11 11:55:18,597 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 11:55:18,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-11 11:55:18,599 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43 2023-11-11 11:55:18,599 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945 2023-11-11 11:55:18,600 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca 2023-11-11 11:55:18,600 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43 empty. 2023-11-11 11:55:18,600 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca empty. 2023-11-11 11:55:18,600 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945 empty. 2023-11-11 11:55:18,600 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43 2023-11-11 11:55:18,600 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca 2023-11-11 11:55:18,601 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945 2023-11-11 11:55:18,601 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-11 11:55:18,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-11 11:55:18,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-11 11:55:18,902 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family2/7a802ee6145140d7b7b68231f776aabe as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/7a802ee6145140d7b7b68231f776aabe 2023-11-11 11:55:18,906 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 998271c54a88643806fe1b6c1978d34b/family2 of 998271c54a88643806fe1b6c1978d34b into 7a802ee6145140d7b7b68231f776aabe(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:55:18,906 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:55:18,907 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b., storeName=998271c54a88643806fe1b6c1978d34b/family2, priority=12, startTime=1699703717334; duration=0sec 2023-11-11 11:55:18,907 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-11 11:55:18,907 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-11-11 11:55:18,907 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-11 11:55:18,907 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-11 11:55:18,907 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. because compaction request was cancelled 2023-11-11 11:55:18,907 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-11 11:55:18,909 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-11 11:55:18,909 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1912): be5c328b64d96b557d201a387d04fa34/family2 is initiating minor compaction (all files) 2023-11-11 11:55:18,909 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of be5c328b64d96b557d201a387d04fa34/family2 in testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:55:18,909 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-f413166c047243caaea4d6a006096d73, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-af9aad0939ef4556ab0757d47af29d98, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-9d9bfccacf39439892dc83099a14166c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-95cd2b2fb9d44b518c882621b5178950] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp, totalSize=20.4 K 2023-11-11 11:55:18,909 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-f413166c047243caaea4d6a006096d73, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703695072 2023-11-11 11:55:18,910 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-af9aad0939ef4556ab0757d47af29d98, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703696863 2023-11-11 11:55:18,910 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-9d9bfccacf39439892dc83099a14166c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703698278 2023-11-11 11:55:18,911 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-95cd2b2fb9d44b518c882621b5178950, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703700097 2023-11-11 11:55:18,923 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): be5c328b64d96b557d201a387d04fa34#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-11 11:55:18,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-d136474a81d94d1e9a20a83d42568946, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-aa9650f16fef4fb2a0e814af62aa97d4, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-ab0d303fc8d74594a2b4e500f523eaaf, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-8eada10ab82b4f0da7a7cdaab690121c] to archive 2023-11-11 11:55:18,966 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:18,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-d136474a81d94d1e9a20a83d42568946 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-d136474a81d94d1e9a20a83d42568946 2023-11-11 11:55:18,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-aa9650f16fef4fb2a0e814af62aa97d4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-aa9650f16fef4fb2a0e814af62aa97d4 2023-11-11 11:55:18,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-ab0d303fc8d74594a2b4e500f523eaaf to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-ab0d303fc8d74594a2b4e500f523eaaf 2023-11-11 11:55:18,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-8eada10ab82b4f0da7a7cdaab690121c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family2/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-8eada10ab82b4f0da7a7cdaab690121c 2023-11-11 11:55:19,008 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-11 11:55:19,009 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => c3c434dd053fdf95e98a3b778602f7ca, NAME => 'ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:55:19,009 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 45cc680593870df452d4141fbb486a43, NAME => 'ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:55:19,009 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8cb9f02ad3781aa733fd732e5fe19945, NAME => 'ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:55:19,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-11 11:55:19,329 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/.tmp/family1/92823c8015824536b010c5d019d582e0 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/92823c8015824536b010c5d019d582e0 2023-11-11 11:55:19,334 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 998271c54a88643806fe1b6c1978d34b/family1 of 998271c54a88643806fe1b6c1978d34b into 92823c8015824536b010c5d019d582e0(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:55:19,334 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:55:19,334 INFO [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1699703718403; duration=0sec 2023-11-11 11:55:19,334 DEBUG [RS:0;jenkins-hbase4:41363-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:55:19,338 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/.tmp/family2/3c1ecd2264464050bfac00d97597315b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/3c1ecd2264464050bfac00d97597315b 2023-11-11 11:55:19,341 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in be5c328b64d96b557d201a387d04fa34/family2 of be5c328b64d96b557d201a387d04fa34 into 3c1ecd2264464050bfac00d97597315b(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:55:19,341 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:55:19,341 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34., storeName=be5c328b64d96b557d201a387d04fa34/family2, priority=12, startTime=1699703717256; duration=0sec 2023-11-11 11:55:19,342 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:55:19,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-3738921820ab429a8b72082afee389a5, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-146911079b654a03a6e1e419f77709e2, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-18a5d622f2584a7aa1d534a3afdd65f8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-10793340a817439e8690a88c1372b2d8, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/d4c99ca711d84780a0e06c46774cc161_SeqId_34_] to archive 2023-11-11 11:55:19,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:19,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-3738921820ab429a8b72082afee389a5 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-3738921820ab429a8b72082afee389a5 2023-11-11 11:55:19,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-146911079b654a03a6e1e419f77709e2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-146911079b654a03a6e1e419f77709e2 2023-11-11 11:55:19,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-18a5d622f2584a7aa1d534a3afdd65f8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-18a5d622f2584a7aa1d534a3afdd65f8 2023-11-11 11:55:19,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-10793340a817439e8690a88c1372b2d8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/testCompactionWithHFileLink=998271c54a88643806fe1b6c1978d34b-10793340a817439e8690a88c1372b2d8 2023-11-11 11:55:19,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/d4c99ca711d84780a0e06c46774cc161_SeqId_34_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/family1/d4c99ca711d84780a0e06c46774cc161_SeqId_34_ 2023-11-11 11:55:19,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-f413166c047243caaea4d6a006096d73, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-af9aad0939ef4556ab0757d47af29d98, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-9d9bfccacf39439892dc83099a14166c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-95cd2b2fb9d44b518c882621b5178950] to archive 2023-11-11 11:55:19,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:19,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-f413166c047243caaea4d6a006096d73 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-f413166c047243caaea4d6a006096d73 2023-11-11 11:55:19,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-af9aad0939ef4556ab0757d47af29d98 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-af9aad0939ef4556ab0757d47af29d98 2023-11-11 11:55:19,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-9d9bfccacf39439892dc83099a14166c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-9d9bfccacf39439892dc83099a14166c 2023-11-11 11:55:19,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-95cd2b2fb9d44b518c882621b5178950 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/family2/testCompactionWithHFileLink=be5c328b64d96b557d201a387d04fa34-95cd2b2fb9d44b518c882621b5178950 2023-11-11 11:55:19,415 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:19,415 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:19,415 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing c3c434dd053fdf95e98a3b778602f7ca, disabling compactions & flushes 2023-11-11 11:55:19,415 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 8cb9f02ad3781aa733fd732e5fe19945, disabling compactions & flushes 2023-11-11 11:55:19,415 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:19,415 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:19,415 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:19,415 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:19,415 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. after waiting 0 ms 2023-11-11 11:55:19,415 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:19,415 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:19,415 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 45cc680593870df452d4141fbb486a43, disabling compactions & flushes 2023-11-11 11:55:19,416 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:19,415 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. after waiting 0 ms 2023-11-11 11:55:19,416 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for c3c434dd053fdf95e98a3b778602f7ca: 2023-11-11 11:55:19,416 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:19,416 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:19,416 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:19,416 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. after waiting 0 ms 2023-11-11 11:55:19,416 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:19,416 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:19,416 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:19,416 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 45cc680593870df452d4141fbb486a43: 2023-11-11 11:55:19,416 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 8cb9f02ad3781aa733fd732e5fe19945: 2023-11-11 11:55:19,418 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 11:55:19,419 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699703719418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703719418"}]},"ts":"1699703719418"} 2023-11-11 11:55:19,419 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699703719418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703719418"}]},"ts":"1699703719418"} 2023-11-11 11:55:19,419 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699703719418"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703719418"}]},"ts":"1699703719418"} 2023-11-11 11:55:19,420 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-11 11:55:19,421 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 11:55:19,421 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703719421"}]},"ts":"1699703719421"} 2023-11-11 11:55:19,422 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-11 11:55:19,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=45cc680593870df452d4141fbb486a43, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8cb9f02ad3781aa733fd732e5fe19945, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c3c434dd053fdf95e98a3b778602f7ca, ASSIGN}] 2023-11-11 11:55:19,435 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=45cc680593870df452d4141fbb486a43, ASSIGN 2023-11-11 11:55:19,435 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8cb9f02ad3781aa733fd732e5fe19945, ASSIGN 2023-11-11 11:55:19,435 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c3c434dd053fdf95e98a3b778602f7ca, ASSIGN 2023-11-11 11:55:19,435 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=45cc680593870df452d4141fbb486a43, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:55:19,436 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8cb9f02ad3781aa733fd732e5fe19945, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:55:19,436 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c3c434dd053fdf95e98a3b778602f7ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:55:19,588 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=45cc680593870df452d4141fbb486a43, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:19,588 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=c3c434dd053fdf95e98a3b778602f7ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:19,588 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8cb9f02ad3781aa733fd732e5fe19945, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:19,588 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699703719588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703719588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703719588"}]},"ts":"1699703719588"} 2023-11-11 11:55:19,588 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699703719588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703719588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703719588"}]},"ts":"1699703719588"} 2023-11-11 11:55:19,588 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699703719588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703719588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703719588"}]},"ts":"1699703719588"} 2023-11-11 11:55:19,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 45cc680593870df452d4141fbb486a43, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:55:19,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure 8cb9f02ad3781aa733fd732e5fe19945, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:55:19,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure c3c434dd053fdf95e98a3b778602f7ca, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:55:19,666 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 11:55:19,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-11 11:55:19,741 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:19,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:19,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8cb9f02ad3781aa733fd732e5fe19945, NAME => 'ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945.', STARTKEY => '1', ENDKEY => '2'} 2023-11-11 11:55:19,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 8cb9f02ad3781aa733fd732e5fe19945 2023-11-11 11:55:19,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:19,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8cb9f02ad3781aa733fd732e5fe19945 2023-11-11 11:55:19,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8cb9f02ad3781aa733fd732e5fe19945 2023-11-11 11:55:19,745 INFO [StoreOpener-8cb9f02ad3781aa733fd732e5fe19945-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8cb9f02ad3781aa733fd732e5fe19945 2023-11-11 11:55:19,746 DEBUG [StoreOpener-8cb9f02ad3781aa733fd732e5fe19945-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1 2023-11-11 11:55:19,747 DEBUG [StoreOpener-8cb9f02ad3781aa733fd732e5fe19945-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1 2023-11-11 11:55:19,747 INFO [StoreOpener-8cb9f02ad3781aa733fd732e5fe19945-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cb9f02ad3781aa733fd732e5fe19945 columnFamilyName family1 2023-11-11 11:55:19,748 INFO [StoreOpener-8cb9f02ad3781aa733fd732e5fe19945-1] regionserver.HStore(310): Store=8cb9f02ad3781aa733fd732e5fe19945/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:19,748 INFO [StoreOpener-8cb9f02ad3781aa733fd732e5fe19945-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8cb9f02ad3781aa733fd732e5fe19945 2023-11-11 11:55:19,749 DEBUG [StoreOpener-8cb9f02ad3781aa733fd732e5fe19945-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2 2023-11-11 11:55:19,749 DEBUG [StoreOpener-8cb9f02ad3781aa733fd732e5fe19945-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2 2023-11-11 11:55:19,749 INFO [StoreOpener-8cb9f02ad3781aa733fd732e5fe19945-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cb9f02ad3781aa733fd732e5fe19945 columnFamilyName family2 2023-11-11 11:55:19,750 INFO [StoreOpener-8cb9f02ad3781aa733fd732e5fe19945-1] regionserver.HStore(310): Store=8cb9f02ad3781aa733fd732e5fe19945/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:19,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945 2023-11-11 11:55:19,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945 2023-11-11 11:55:19,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:55:19,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8cb9f02ad3781aa733fd732e5fe19945 2023-11-11 11:55:19,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:55:19,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8cb9f02ad3781aa733fd732e5fe19945; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58919462, jitterRate=-0.12203159928321838}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:55:19,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8cb9f02ad3781aa733fd732e5fe19945: 2023-11-11 11:55:19,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945., pid=110, masterSystemTime=1699703719741 2023-11-11 11:55:19,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:19,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:19,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:19,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 45cc680593870df452d4141fbb486a43, NAME => 'ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43.', STARTKEY => '', ENDKEY => '1'} 2023-11-11 11:55:19,758 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8cb9f02ad3781aa733fd732e5fe19945, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:19,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 45cc680593870df452d4141fbb486a43 2023-11-11 11:55:19,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:19,758 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699703719758"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703719758"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703719758"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703719758"}]},"ts":"1699703719758"} 2023-11-11 11:55:19,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 45cc680593870df452d4141fbb486a43 2023-11-11 11:55:19,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 45cc680593870df452d4141fbb486a43 2023-11-11 11:55:19,759 INFO [StoreOpener-45cc680593870df452d4141fbb486a43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 45cc680593870df452d4141fbb486a43 2023-11-11 11:55:19,760 DEBUG [StoreOpener-45cc680593870df452d4141fbb486a43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1 2023-11-11 11:55:19,760 DEBUG [StoreOpener-45cc680593870df452d4141fbb486a43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1 2023-11-11 11:55:19,760 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=107 2023-11-11 11:55:19,760 INFO [StoreOpener-45cc680593870df452d4141fbb486a43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45cc680593870df452d4141fbb486a43 columnFamilyName family1 2023-11-11 11:55:19,760 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure 8cb9f02ad3781aa733fd732e5fe19945, server=jenkins-hbase4.apache.org,41363,1699703601801 in 169 msec 2023-11-11 11:55:19,761 INFO [StoreOpener-45cc680593870df452d4141fbb486a43-1] regionserver.HStore(310): Store=45cc680593870df452d4141fbb486a43/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:19,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8cb9f02ad3781aa733fd732e5fe19945, ASSIGN in 327 msec 2023-11-11 11:55:19,762 INFO [StoreOpener-45cc680593870df452d4141fbb486a43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 45cc680593870df452d4141fbb486a43 2023-11-11 11:55:19,763 DEBUG [StoreOpener-45cc680593870df452d4141fbb486a43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2 2023-11-11 11:55:19,763 DEBUG [StoreOpener-45cc680593870df452d4141fbb486a43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2 2023-11-11 11:55:19,763 INFO [StoreOpener-45cc680593870df452d4141fbb486a43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45cc680593870df452d4141fbb486a43 columnFamilyName family2 2023-11-11 11:55:19,764 INFO [StoreOpener-45cc680593870df452d4141fbb486a43-1] regionserver.HStore(310): Store=45cc680593870df452d4141fbb486a43/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:19,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43 2023-11-11 11:55:19,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43 2023-11-11 11:55:19,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:55:19,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 45cc680593870df452d4141fbb486a43 2023-11-11 11:55:19,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:55:19,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 45cc680593870df452d4141fbb486a43; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63970048, jitterRate=-0.046772003173828125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:55:19,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 45cc680593870df452d4141fbb486a43: 2023-11-11 11:55:19,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43., pid=109, masterSystemTime=1699703719741 2023-11-11 11:55:19,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:19,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:19,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:19,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3c434dd053fdf95e98a3b778602f7ca, NAME => 'ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca.', STARTKEY => '2', ENDKEY => ''} 2023-11-11 11:55:19,772 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=45cc680593870df452d4141fbb486a43, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:19,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction c3c434dd053fdf95e98a3b778602f7ca 2023-11-11 11:55:19,772 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699703719771"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703719771"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703719771"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703719771"}]},"ts":"1699703719771"} 2023-11-11 11:55:19,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:19,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c3c434dd053fdf95e98a3b778602f7ca 2023-11-11 11:55:19,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c3c434dd053fdf95e98a3b778602f7ca 2023-11-11 11:55:19,773 INFO [StoreOpener-c3c434dd053fdf95e98a3b778602f7ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c3c434dd053fdf95e98a3b778602f7ca 2023-11-11 11:55:19,774 DEBUG [StoreOpener-c3c434dd053fdf95e98a3b778602f7ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1 2023-11-11 11:55:19,775 DEBUG [StoreOpener-c3c434dd053fdf95e98a3b778602f7ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1 2023-11-11 11:55:19,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-11-11 11:55:19,775 INFO [StoreOpener-c3c434dd053fdf95e98a3b778602f7ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3c434dd053fdf95e98a3b778602f7ca columnFamilyName family1 2023-11-11 11:55:19,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 45cc680593870df452d4141fbb486a43, server=jenkins-hbase4.apache.org,41363,1699703601801 in 183 msec 2023-11-11 11:55:19,776 INFO [StoreOpener-c3c434dd053fdf95e98a3b778602f7ca-1] regionserver.HStore(310): Store=c3c434dd053fdf95e98a3b778602f7ca/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:19,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=45cc680593870df452d4141fbb486a43, ASSIGN in 342 msec 2023-11-11 11:55:19,776 INFO [StoreOpener-c3c434dd053fdf95e98a3b778602f7ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c3c434dd053fdf95e98a3b778602f7ca 2023-11-11 11:55:19,777 DEBUG [StoreOpener-c3c434dd053fdf95e98a3b778602f7ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2 2023-11-11 11:55:19,777 DEBUG [StoreOpener-c3c434dd053fdf95e98a3b778602f7ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2 2023-11-11 11:55:19,778 INFO [StoreOpener-c3c434dd053fdf95e98a3b778602f7ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3c434dd053fdf95e98a3b778602f7ca columnFamilyName family2 2023-11-11 11:55:19,778 INFO [StoreOpener-c3c434dd053fdf95e98a3b778602f7ca-1] regionserver.HStore(310): Store=c3c434dd053fdf95e98a3b778602f7ca/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:19,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca 2023-11-11 11:55:19,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca 2023-11-11 11:55:19,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:55:19,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c3c434dd053fdf95e98a3b778602f7ca 2023-11-11 11:55:19,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:55:19,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c3c434dd053fdf95e98a3b778602f7ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61855815, jitterRate=-0.07827652990818024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:55:19,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c3c434dd053fdf95e98a3b778602f7ca: 2023-11-11 11:55:19,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca., pid=111, masterSystemTime=1699703719741 2023-11-11 11:55:19,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:19,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:19,786 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=c3c434dd053fdf95e98a3b778602f7ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:19,786 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699703719786"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703719786"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703719786"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703719786"}]},"ts":"1699703719786"} 2023-11-11 11:55:19,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=108 2023-11-11 11:55:19,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure c3c434dd053fdf95e98a3b778602f7ca, server=jenkins-hbase4.apache.org,41363,1699703601801 in 196 msec 2023-11-11 11:55:19,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=105 2023-11-11 11:55:19,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c3c434dd053fdf95e98a3b778602f7ca, ASSIGN in 356 msec 2023-11-11 11:55:19,790 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 11:55:19,790 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703719790"}]},"ts":"1699703719790"} 2023-11-11 11:55:19,791 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-11 11:55:19,793 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 11:55:19,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1990 sec 2023-11-11 11:55:20,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-11 11:55:20,703 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-11 11:55:20,709 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:20,710 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:20,710 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:20,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:20,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-11 11:55:20,713 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-11 11:55:20,713 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:20,713 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-11 11:55:20,713 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-11 11:55:20,714 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:20,714 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:20,715 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:20,715 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:20,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:20,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:20,716 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:20,716 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:20,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:20,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:20,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:20,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:20,717 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-11 11:55:20,717 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-11 11:55:20,717 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-11 11:55:20,717 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:20,717 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-11 11:55:20,717 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:20,717 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. started... 2023-11-11 11:55:20,717 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:20,717 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:55:20,720 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:20,720 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:20,720 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. started... 2023-11-11 11:55:20,720 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 45cc680593870df452d4141fbb486a43 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 11:55:20,720 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. started... 2023-11-11 11:55:20,720 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c3c434dd053fdf95e98a3b778602f7ca 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 11:55:20,720 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 8cb9f02ad3781aa733fd732e5fe19945 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 11:55:20,734 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111cc587eab790147269361db1d5029d731 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231111cc587eab790147269361db1d5029d731 2023-11-11 11:55:20,735 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311115a38b83028f042ef90678bd5641f0ca2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311115a38b83028f042ef90678bd5641f0ca2 2023-11-11 11:55:20,742 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family1/584dd4596e7a4adf9327d4407fd212c9 2023-11-11 11:55:21,135 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111d2096e71644d4bf3b5545cbf547fd10b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231111d2096e71644d4bf3b5545cbf547fd10b 2023-11-11 11:55:21,143 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family1/10202a8a915b46598966e064a88e3f84 2023-11-11 11:55:21,154 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111fc3a97dc3dea461bb2a8f3956c32b626 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231111fc3a97dc3dea461bb2a8f3956c32b626 2023-11-11 11:55:21,155 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111831e1f1727c443948a69385685e03428 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231111831e1f1727c443948a69385685e03428 2023-11-11 11:55:21,540 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family1/fbc38a4dfc01499a9c83be049479ae1f 2023-11-11 11:55:21,558 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family2/a7ebf20fa3084adf96791c8a931503ef 2023-11-11 11:55:21,559 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family2/c1991f3cea854498bf5db36f7cba2cbb 2023-11-11 11:55:21,562 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family1/584dd4596e7a4adf9327d4407fd212c9 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/584dd4596e7a4adf9327d4407fd212c9 2023-11-11 11:55:21,563 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family1/10202a8a915b46598966e064a88e3f84 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/10202a8a915b46598966e064a88e3f84 2023-11-11 11:55:21,566 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/584dd4596e7a4adf9327d4407fd212c9, entries=4, sequenceid=5, filesize=5.4 K 2023-11-11 11:55:21,567 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family2/a7ebf20fa3084adf96791c8a931503ef as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/a7ebf20fa3084adf96791c8a931503ef 2023-11-11 11:55:21,567 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/10202a8a915b46598966e064a88e3f84, entries=4, sequenceid=5, filesize=5.4 K 2023-11-11 11:55:21,568 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family2/c1991f3cea854498bf5db36f7cba2cbb as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/c1991f3cea854498bf5db36f7cba2cbb 2023-11-11 11:55:21,570 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/a7ebf20fa3084adf96791c8a931503ef, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 11:55:21,571 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/c1991f3cea854498bf5db36f7cba2cbb, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 11:55:21,571 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 45cc680593870df452d4141fbb486a43 in 851ms, sequenceid=5, compaction requested=false 2023-11-11 11:55:21,571 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-11 11:55:21,572 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8cb9f02ad3781aa733fd732e5fe19945 in 852ms, sequenceid=5, compaction requested=false 2023-11-11 11:55:21,572 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-11 11:55:21,573 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8cb9f02ad3781aa733fd732e5fe19945: 2023-11-11 11:55:21,573 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 45cc680593870df452d4141fbb486a43: 2023-11-11 11:55:21,573 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:21,573 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:21,573 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:55:21,573 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:55:21,955 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311111bd5fee04f1840588e01474f31e79688 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311111bd5fee04f1840588e01474f31e79688 2023-11-11 11:55:22,360 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family2/f6d6208418934d0189dc7241e2d2df16 2023-11-11 11:55:22,364 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family1/fbc38a4dfc01499a9c83be049479ae1f as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/fbc38a4dfc01499a9c83be049479ae1f 2023-11-11 11:55:22,367 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/fbc38a4dfc01499a9c83be049479ae1f, entries=4, sequenceid=5, filesize=5.4 K 2023-11-11 11:55:22,368 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family2/f6d6208418934d0189dc7241e2d2df16 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/f6d6208418934d0189dc7241e2d2df16 2023-11-11 11:55:22,371 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/f6d6208418934d0189dc7241e2d2df16, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 11:55:22,372 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c3c434dd053fdf95e98a3b778602f7ca in 1652ms, sequenceid=5, compaction requested=false 2023-11-11 11:55:22,372 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c3c434dd053fdf95e98a3b778602f7ca: 2023-11-11 11:55:22,372 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:55:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:55:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-11 11:55:22,372 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-11 11:55:22,374 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:22,374 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:22,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:22,374 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:22,374 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:22,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:22,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:22,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:22,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:22,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-11 11:55:22,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f0f64ed[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:22,376 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-11 11:55:22,376 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:22,377 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:22,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:22,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:22,377 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-11 11:55:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-11 11:55:22,377 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:22,379 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-11 11:55:22,379 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,379 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:22,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:22,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:22,379 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-11 11:55:22,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:22,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:22,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:22,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:22,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:22,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:22,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-11 11:55:22,382 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-11 11:55:22,382 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:22,382 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:22,382 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-11 11:55:22,382 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:22,384 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:22,384 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:22,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:22,384 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:22,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:22,385 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:22,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:22,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:22,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:22,386 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,388 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,388 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:22,388 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:22,388 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:22,388 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:22,388 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,388 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:22,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:22,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-11 11:55:22,389 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:22,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-11 11:55:22,389 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:22,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:22,389 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:22,389 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:22,389 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:22,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:22,489 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:22,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:22,491 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:22,492 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:22,492 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:22,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:22,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:22,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-11 11:55:22,496 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-11 11:55:22,496 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:22,496 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-11 11:55:22,496 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-11 11:55:22,496 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:22,497 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:22,498 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:22,498 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:22,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:22,498 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:22,498 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:22,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:22,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:22,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:22,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:22,500 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-11 11:55:22,505 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-11 11:55:22,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-11 11:55:22,505 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-11 11:55:22,505 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:22,505 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-11 11:55:22,505 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:22,505 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. started... 2023-11-11 11:55:22,505 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 45cc680593870df452d4141fbb486a43 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 11:55:22,506 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:22,506 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. started... 2023-11-11 11:55:22,506 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c3c434dd053fdf95e98a3b778602f7ca 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 11:55:22,509 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:55:22,509 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:22,509 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:22,509 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. started... 2023-11-11 11:55:22,509 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 8cb9f02ad3781aa733fd732e5fe19945 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 11:55:22,531 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111057ab1b019a54c2bb69e5ce3d7c53548 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231111057ab1b019a54c2bb69e5ce3d7c53548 2023-11-11 11:55:22,532 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311111f96bdcef0334b2a845073f7b3537169 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311111f96bdcef0334b2a845073f7b3537169 2023-11-11 11:55:22,535 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family1/e90bb78560674d31b7f54db2bc59acf0 2023-11-11 11:55:22,931 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111540fd440a298417e8db49161a8f172ee to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231111540fd440a298417e8db49161a8f172ee 2023-11-11 11:55:22,937 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family1/b62104a7989d428fb575e579912f112f 2023-11-11 11:55:22,948 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111ff79d623d37d47778d4c3184a255d1e3 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231111ff79d623d37d47778d4c3184a255d1e3 2023-11-11 11:55:23,077 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:55:23,077 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37027dbb to 127.0.0.1:59344 2023-11-11 11:55:23,077 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:55:23,078 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:55:23,078 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6206c887 to 127.0.0.1:59344 2023-11-11 11:55:23,078 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:55:23,136 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-11-11 11:55:23,336 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family1/2ad7f19a25bc480191d42c1502fca721 2023-11-11 11:55:23,349 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111138410a28dc4f413bb5ba940a8c6987e8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023111138410a28dc4f413bb5ba940a8c6987e8 2023-11-11 11:55:23,353 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family2/78b62127481045829eb7c6ecb0133572 2023-11-11 11:55:23,354 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family2/020143ecd5ae4e51a4861cd50a982e42 2023-11-11 11:55:23,358 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family1/b62104a7989d428fb575e579912f112f as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/b62104a7989d428fb575e579912f112f 2023-11-11 11:55:23,358 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family1/e90bb78560674d31b7f54db2bc59acf0 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/e90bb78560674d31b7f54db2bc59acf0 2023-11-11 11:55:23,361 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/b62104a7989d428fb575e579912f112f, entries=4, sequenceid=9, filesize=5.4 K 2023-11-11 11:55:23,361 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/e90bb78560674d31b7f54db2bc59acf0, entries=4, sequenceid=9, filesize=5.4 K 2023-11-11 11:55:23,362 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family2/78b62127481045829eb7c6ecb0133572 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/78b62127481045829eb7c6ecb0133572 2023-11-11 11:55:23,362 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family2/020143ecd5ae4e51a4861cd50a982e42 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/020143ecd5ae4e51a4861cd50a982e42 2023-11-11 11:55:23,365 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/78b62127481045829eb7c6ecb0133572, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 11:55:23,365 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/020143ecd5ae4e51a4861cd50a982e42, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 11:55:23,366 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c3c434dd053fdf95e98a3b778602f7ca in 860ms, sequenceid=9, compaction requested=false 2023-11-11 11:55:23,366 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8cb9f02ad3781aa733fd732e5fe19945 in 857ms, sequenceid=9, compaction requested=false 2023-11-11 11:55:23,366 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c3c434dd053fdf95e98a3b778602f7ca: 2023-11-11 11:55:23,366 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8cb9f02ad3781aa733fd732e5fe19945: 2023-11-11 11:55:23,366 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:23,366 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:23,366 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:55:23,366 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:55:23,750 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111a43239468c544bf8a4f19d42a1893d38 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231111a43239468c544bf8a4f19d42a1893d38 2023-11-11 11:55:24,157 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family2/c59fe61101a14f61a1894e750b24023a 2023-11-11 11:55:24,161 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family1/2ad7f19a25bc480191d42c1502fca721 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/2ad7f19a25bc480191d42c1502fca721 2023-11-11 11:55:24,165 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/2ad7f19a25bc480191d42c1502fca721, entries=4, sequenceid=9, filesize=5.4 K 2023-11-11 11:55:24,165 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family2/c59fe61101a14f61a1894e750b24023a as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/c59fe61101a14f61a1894e750b24023a 2023-11-11 11:55:24,168 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/c59fe61101a14f61a1894e750b24023a, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 11:55:24,169 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 45cc680593870df452d4141fbb486a43 in 1664ms, sequenceid=9, compaction requested=false 2023-11-11 11:55:24,169 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 45cc680593870df452d4141fbb486a43: 2023-11-11 11:55:24,169 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:24,169 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:55:24,169 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:55:24,169 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,169 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-11 11:55:24,169 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-11 11:55:24,171 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,171 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:24,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:24,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:24,172 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:24,172 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:24,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:24,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:24,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:24,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:24,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-11 11:55:24,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fcab00a[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:24,173 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-11 11:55:24,173 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:24,175 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:24,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:24,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:24,175 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-11 11:55:24,175 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-11 11:55:24,175 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:24,175 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,175 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:24,178 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-11 11:55:24,178 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,178 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:24,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,178 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-11 11:55:24,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:24,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:24,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:24,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:24,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:24,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:24,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:24,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:24,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-11 11:55:24,180 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-11 11:55:24,180 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:24,180 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:24,180 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-11 11:55:24,180 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:24,182 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:24,182 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:24,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:24,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:24,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:24,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:24,182 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:24,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:24,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:24,183 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:24,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:24,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:24,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:24,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:24,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:24,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,184 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:24,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:24,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,186 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,186 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:24,186 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:24,187 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:24,187 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:24,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-11 11:55:24,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:24,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:24,187 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:24,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-11 11:55:24,187 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:24,187 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,187 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:24,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:24,187 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:24,187 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:24,187 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:24,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:24,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:24,287 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:24,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:24,289 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:24,290 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:24,290 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:24,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:24,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:24,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-11 11:55:24,294 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-11 11:55:24,294 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:24,294 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-11 11:55:24,294 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-11 11:55:24,294 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:24,294 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:24,296 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,296 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:24,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:24,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:24,296 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:24,296 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:24,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:24,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:24,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:24,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:24,297 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-11 11:55:24,297 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-11 11:55:24,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-11 11:55:24,297 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-11 11:55:24,297 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:24,297 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-11 11:55:24,298 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:24,298 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. started... 2023-11-11 11:55:24,298 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:55:24,298 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:24,298 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:24,298 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 45cc680593870df452d4141fbb486a43 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 11:55:24,298 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:24,298 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. started... 2023-11-11 11:55:24,298 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. started... 2023-11-11 11:55:24,298 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c3c434dd053fdf95e98a3b778602f7ca 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 11:55:24,298 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 8cb9f02ad3781aa733fd732e5fe19945 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 11:55:24,325 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111a6ca6654271e4705a98e439e21dcb065 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231111a6ca6654271e4705a98e439e21dcb065 2023-11-11 11:55:24,325 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111177e0bda7cde74fb79b8fa7c6f24e9539 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023111177e0bda7cde74fb79b8fa7c6f24e9539 2023-11-11 11:55:24,336 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family1/7d4dab61333b4ad39beaadde33dc7d94 2023-11-11 11:55:24,338 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family1/475fb5f2ff1a4f4eab4a606f13504f97 2023-11-11 11:55:24,360 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111cc49ad0b2ab6416892c5e36d29139e0a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231111cc49ad0b2ab6416892c5e36d29139e0a 2023-11-11 11:55:24,362 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311111d61e81ac2a745a19c622f931b737fcd to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311111d61e81ac2a745a19c622f931b737fcd 2023-11-11 11:55:24,370 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family2/6888dcfb9c8c494ea59c29672c2f66e9 2023-11-11 11:55:24,373 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family1/7d4dab61333b4ad39beaadde33dc7d94 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/7d4dab61333b4ad39beaadde33dc7d94 2023-11-11 11:55:24,376 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/7d4dab61333b4ad39beaadde33dc7d94, entries=4, sequenceid=13, filesize=5.4 K 2023-11-11 11:55:24,377 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family2/6888dcfb9c8c494ea59c29672c2f66e9 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/6888dcfb9c8c494ea59c29672c2f66e9 2023-11-11 11:55:24,380 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/6888dcfb9c8c494ea59c29672c2f66e9, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 11:55:24,381 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8cb9f02ad3781aa733fd732e5fe19945 in 83ms, sequenceid=13, compaction requested=true 2023-11-11 11:55:24,381 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8cb9f02ad3781aa733fd732e5fe19945: 2023-11-11 11:55:24,381 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:24,381 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:55:24,718 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111b1c60c8a2edd4b33b100b42137738f22 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231111b1c60c8a2edd4b33b100b42137738f22 2023-11-11 11:55:24,766 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family2/7aecc22f616f45df95b9dc1fd2dc4705 2023-11-11 11:55:24,771 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family1/475fb5f2ff1a4f4eab4a606f13504f97 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/475fb5f2ff1a4f4eab4a606f13504f97 2023-11-11 11:55:24,775 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/475fb5f2ff1a4f4eab4a606f13504f97, entries=4, sequenceid=13, filesize=5.4 K 2023-11-11 11:55:24,775 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family2/7aecc22f616f45df95b9dc1fd2dc4705 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/7aecc22f616f45df95b9dc1fd2dc4705 2023-11-11 11:55:24,779 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/7aecc22f616f45df95b9dc1fd2dc4705, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 11:55:24,780 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 45cc680593870df452d4141fbb486a43 in 482ms, sequenceid=13, compaction requested=true 2023-11-11 11:55:24,780 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 45cc680593870df452d4141fbb486a43: 2023-11-11 11:55:24,780 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:24,780 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:55:25,123 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family1/d21b5141bab44c8e8f055838cb7ea705 2023-11-11 11:55:25,246 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 11:55:25,536 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111e9d305cadcfa40829a9c3d995265f1f6 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231111e9d305cadcfa40829a9c3d995265f1f6 2023-11-11 11:55:25,941 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family2/f59b6b22b327490da8f3235f9443e6c9 2023-11-11 11:55:25,945 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family1/d21b5141bab44c8e8f055838cb7ea705 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/d21b5141bab44c8e8f055838cb7ea705 2023-11-11 11:55:25,948 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/d21b5141bab44c8e8f055838cb7ea705, entries=4, sequenceid=13, filesize=5.4 K 2023-11-11 11:55:25,949 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family2/f59b6b22b327490da8f3235f9443e6c9 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/f59b6b22b327490da8f3235f9443e6c9 2023-11-11 11:55:25,952 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/f59b6b22b327490da8f3235f9443e6c9, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 11:55:25,953 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c3c434dd053fdf95e98a3b778602f7ca in 1655ms, sequenceid=13, compaction requested=true 2023-11-11 11:55:25,953 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c3c434dd053fdf95e98a3b778602f7ca: 2023-11-11 11:55:25,953 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:25,953 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:55:25,953 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:55:25,953 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,953 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-11 11:55:25,953 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-11 11:55:25,955 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,955 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:25,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:25,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:25,955 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:25,955 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:25,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-11 11:55:25,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@568760b0[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:25,957 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-11 11:55:25,957 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:25,958 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:25,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:25,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-11 11:55:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-11 11:55:25,958 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:25,958 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:25,961 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,961 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-11 11:55:25,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:25,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:25,961 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:25,961 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-11 11:55:25,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:25,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:25,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:25,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:25,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:25,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-11 11:55:25,963 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-11 11:55:25,963 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:25,963 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:25,963 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-11 11:55:25,963 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:25,969 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:25,969 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:25,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:25,969 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:25,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:25,969 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:25,970 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,973 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:25,973 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:25,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-11 11:55:25,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:25,973 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:25,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-11 11:55:25,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:25,973 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:25,973 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:25,973 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:25,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:25,974 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:25,974 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:25,973 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:25,974 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:25,974 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:25,974 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:26,074 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:26,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:26,076 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:26,076 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:26,076 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:26,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:26,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:26,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-11 11:55:26,081 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-11 11:55:26,081 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:26,081 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-11 11:55:26,081 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-11 11:55:26,081 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:26,081 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:26,083 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:26,083 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:26,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:26,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:26,083 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:26,083 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:26,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:26,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:26,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:26,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:26,084 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-11 11:55:26,084 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-11 11:55:26,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-11 11:55:26,084 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-11 11:55:26,084 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:26,084 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-11 11:55:26,084 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:26,084 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. started... 2023-11-11 11:55:26,085 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:26,085 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. started... 2023-11-11 11:55:26,085 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:26,085 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:55:26,085 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c3c434dd053fdf95e98a3b778602f7ca 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 11:55:26,085 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. started... 2023-11-11 11:55:26,085 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 45cc680593870df452d4141fbb486a43 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 11:55:26,085 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 8cb9f02ad3781aa733fd732e5fe19945 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 11:55:26,085 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:26,499 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311111c0d6720a783418eb5d49966204ccba1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311111c0d6720a783418eb5d49966204ccba1 2023-11-11 11:55:26,500 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111187164d9700c14e1984452612af17cb60 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023111187164d9700c14e1984452612af17cb60 2023-11-11 11:55:26,500 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111b8ea08bf074842d6b3abe9696e79a900 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231111b8ea08bf074842d6b3abe9696e79a900 2023-11-11 11:55:26,905 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family1/3a868fba713540ab8137ebd37ecdbe19 2023-11-11 11:55:26,906 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family1/0e1443c2d4d547b5ae9d15d8effedbb6 2023-11-11 11:55:26,906 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family1/d753653ffbef4fd7852c7ef72a21a4d0 2023-11-11 11:55:27,330 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111170dfde94fd9d429eae7e0dc4c8326a48 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023111170dfde94fd9d429eae7e0dc4c8326a48 2023-11-11 11:55:27,330 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111c651538f6dda4f3f98db76d49076a8fe to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231111c651538f6dda4f3f98db76d49076a8fe 2023-11-11 11:55:27,330 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111bbabdf640024494988de55b07e1642fc to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231111bbabdf640024494988de55b07e1642fc 2023-11-11 11:55:27,735 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family2/fb6fc1a5c69b448ca24c73bbc658176e 2023-11-11 11:55:27,735 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family2/a02365af49d94dc391bdd6f826414a9b 2023-11-11 11:55:27,735 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family2/25c75a85a21d47f4b9b5d9c3899491c6 2023-11-11 11:55:27,739 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family1/3a868fba713540ab8137ebd37ecdbe19 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/3a868fba713540ab8137ebd37ecdbe19 2023-11-11 11:55:27,739 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family1/0e1443c2d4d547b5ae9d15d8effedbb6 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/0e1443c2d4d547b5ae9d15d8effedbb6 2023-11-11 11:55:27,740 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family1/d753653ffbef4fd7852c7ef72a21a4d0 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/d753653ffbef4fd7852c7ef72a21a4d0 2023-11-11 11:55:27,743 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/3a868fba713540ab8137ebd37ecdbe19, entries=4, sequenceid=17, filesize=5.4 K 2023-11-11 11:55:27,743 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/0e1443c2d4d547b5ae9d15d8effedbb6, entries=4, sequenceid=17, filesize=5.4 K 2023-11-11 11:55:27,744 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/d753653ffbef4fd7852c7ef72a21a4d0, entries=4, sequenceid=17, filesize=5.4 K 2023-11-11 11:55:27,744 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family2/a02365af49d94dc391bdd6f826414a9b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/a02365af49d94dc391bdd6f826414a9b 2023-11-11 11:55:27,744 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family2/fb6fc1a5c69b448ca24c73bbc658176e as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/fb6fc1a5c69b448ca24c73bbc658176e 2023-11-11 11:55:27,745 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family2/25c75a85a21d47f4b9b5d9c3899491c6 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/25c75a85a21d47f4b9b5d9c3899491c6 2023-11-11 11:55:27,748 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/fb6fc1a5c69b448ca24c73bbc658176e, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 11:55:27,748 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/a02365af49d94dc391bdd6f826414a9b, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 11:55:27,748 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/25c75a85a21d47f4b9b5d9c3899491c6, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 11:55:27,749 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8cb9f02ad3781aa733fd732e5fe19945 in 1664ms, sequenceid=17, compaction requested=true 2023-11-11 11:55:27,749 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 45cc680593870df452d4141fbb486a43 in 1664ms, sequenceid=17, compaction requested=true 2023-11-11 11:55:27,749 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8cb9f02ad3781aa733fd732e5fe19945: 2023-11-11 11:55:27,749 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 45cc680593870df452d4141fbb486a43: 2023-11-11 11:55:27,749 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c3c434dd053fdf95e98a3b778602f7ca in 1664ms, sequenceid=17, compaction requested=true 2023-11-11 11:55:27,749 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:27,749 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c3c434dd053fdf95e98a3b778602f7ca: 2023-11-11 11:55:27,749 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:27,749 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:27,749 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:55:27,749 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:55:27,750 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:55:27,750 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:55:27,750 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,750 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-11 11:55:27,750 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-11 11:55:27,751 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,751 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:27,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:27,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:27,752 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:27,752 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:27,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:27,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:27,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:27,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:27,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-11 11:55:27,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46e7e04c[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:27,753 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-11 11:55:27,753 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:27,755 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:27,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:27,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-11 11:55:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-11 11:55:27,755 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:27,755 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,755 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:27,757 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,757 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-11 11:55:27,757 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:27,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:27,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:27,757 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-11 11:55:27,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:27,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:27,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:27,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:27,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:27,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:27,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-11 11:55:27,759 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-11 11:55:27,759 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:27,759 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:27,759 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-11 11:55:27,759 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:27,761 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:27,761 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:27,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:27,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:27,761 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:27,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:27,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:27,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:27,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:27,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:27,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:27,762 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:27,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:27,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,763 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:27,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:27,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,765 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,765 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:27,765 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:27,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:27,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-11 11:55:27,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:27,765 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:27,765 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:27,765 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:27,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:27,766 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,766 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:27,766 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:27,766 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:27,766 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:27,766 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:27,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:27,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:27,866 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:27,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:27,878 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:27,889 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:27,896 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:27,896 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:27,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:27,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:27,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-11 11:55:27,923 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-11 11:55:27,923 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:27,923 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-11 11:55:27,923 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-11 11:55:27,923 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:27,923 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:27,926 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:27,926 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:27,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:27,926 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:27,926 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:27,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:27,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:27,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:27,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:27,927 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-11 11:55:27,927 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-11 11:55:27,927 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-11 11:55:27,927 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-11 11:55:27,927 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:27,927 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-11 11:55:27,928 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:27,928 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:55:27,928 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:27,928 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. started... 2023-11-11 11:55:27,928 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:27,928 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:27,928 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 45cc680593870df452d4141fbb486a43 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 11:55:27,928 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. started... 2023-11-11 11:55:27,928 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. started... 2023-11-11 11:55:27,928 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 8cb9f02ad3781aa733fd732e5fe19945 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 11:55:27,928 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing c3c434dd053fdf95e98a3b778602f7ca 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 11:55:27,947 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family1/f57b010c3dd84fecb35178528bdb70f7 2023-11-11 11:55:27,948 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family1/c557ea1415d846f6a1b2b652d6805a97 2023-11-11 11:55:27,951 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f57b010c3dd84fecb35178528bdb70f7 2023-11-11 11:55:27,952 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c557ea1415d846f6a1b2b652d6805a97 2023-11-11 11:55:28,346 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family1/d399f09f9f844b22b4f48ff15b1f3045 2023-11-11 11:55:28,349 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d399f09f9f844b22b4f48ff15b1f3045 2023-11-11 11:55:28,367 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family2/938d3c88d9d9477ca5ddd31875dcad49 2023-11-11 11:55:28,368 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family2/9aefaf1a13f742ff83da118b31fbb081 2023-11-11 11:55:28,370 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 938d3c88d9d9477ca5ddd31875dcad49 2023-11-11 11:55:28,371 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family1/f57b010c3dd84fecb35178528bdb70f7 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/f57b010c3dd84fecb35178528bdb70f7 2023-11-11 11:55:28,371 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9aefaf1a13f742ff83da118b31fbb081 2023-11-11 11:55:28,372 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family1/c557ea1415d846f6a1b2b652d6805a97 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/c557ea1415d846f6a1b2b652d6805a97 2023-11-11 11:55:28,374 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f57b010c3dd84fecb35178528bdb70f7 2023-11-11 11:55:28,375 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/f57b010c3dd84fecb35178528bdb70f7, entries=3, sequenceid=23, filesize=5.0 K 2023-11-11 11:55:28,375 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family2/938d3c88d9d9477ca5ddd31875dcad49 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/938d3c88d9d9477ca5ddd31875dcad49 2023-11-11 11:55:28,375 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c557ea1415d846f6a1b2b652d6805a97 2023-11-11 11:55:28,376 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/c557ea1415d846f6a1b2b652d6805a97, entries=3, sequenceid=23, filesize=5.0 K 2023-11-11 11:55:28,376 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family2/9aefaf1a13f742ff83da118b31fbb081 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/9aefaf1a13f742ff83da118b31fbb081 2023-11-11 11:55:28,379 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 938d3c88d9d9477ca5ddd31875dcad49 2023-11-11 11:55:28,379 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/938d3c88d9d9477ca5ddd31875dcad49, entries=1, sequenceid=23, filesize=5.0 K 2023-11-11 11:55:28,380 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9aefaf1a13f742ff83da118b31fbb081 2023-11-11 11:55:28,380 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/9aefaf1a13f742ff83da118b31fbb081, entries=1, sequenceid=23, filesize=5.0 K 2023-11-11 11:55:28,380 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8cb9f02ad3781aa733fd732e5fe19945 in 452ms, sequenceid=23, compaction requested=true 2023-11-11 11:55:28,380 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8cb9f02ad3781aa733fd732e5fe19945: 2023-11-11 11:55:28,380 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:28,380 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:55:28,380 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c3c434dd053fdf95e98a3b778602f7ca in 452ms, sequenceid=23, compaction requested=true 2023-11-11 11:55:28,380 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for c3c434dd053fdf95e98a3b778602f7ca: 2023-11-11 11:55:28,380 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:28,380 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:55:28,760 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family2/5e36aedab7a048c1bb3136682450bec2 2023-11-11 11:55:28,763 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e36aedab7a048c1bb3136682450bec2 2023-11-11 11:55:28,764 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family1/d399f09f9f844b22b4f48ff15b1f3045 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/d399f09f9f844b22b4f48ff15b1f3045 2023-11-11 11:55:28,767 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d399f09f9f844b22b4f48ff15b1f3045 2023-11-11 11:55:28,768 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/d399f09f9f844b22b4f48ff15b1f3045, entries=3, sequenceid=23, filesize=5.0 K 2023-11-11 11:55:28,768 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family2/5e36aedab7a048c1bb3136682450bec2 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/5e36aedab7a048c1bb3136682450bec2 2023-11-11 11:55:28,771 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e36aedab7a048c1bb3136682450bec2 2023-11-11 11:55:28,772 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/5e36aedab7a048c1bb3136682450bec2, entries=1, sequenceid=23, filesize=5.0 K 2023-11-11 11:55:28,772 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 45cc680593870df452d4141fbb486a43 in 844ms, sequenceid=23, compaction requested=true 2023-11-11 11:55:28,772 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 45cc680593870df452d4141fbb486a43: 2023-11-11 11:55:28,772 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:28,772 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:55:28,772 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:55:28,772 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,773 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-11 11:55:28,773 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-11 11:55:28,774 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,774 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:28,775 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:28,775 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:28,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-11 11:55:28,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@525bcc71[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:28,776 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-11 11:55:28,776 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:28,777 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:28,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:28,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:28,777 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-11 11:55:28,777 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-11 11:55:28,777 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:28,777 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,777 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:28,778 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,778 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-11 11:55:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:28,778 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:28,779 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-11 11:55:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:28,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:28,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:28,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:28,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:28,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-11 11:55:28,781 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-11 11:55:28,781 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:28,781 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:28,781 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-11 11:55:28,781 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:28,784 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:28,784 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:28,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:28,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:28,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:28,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:28,784 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:28,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:28,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:28,784 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:28,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:28,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:28,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:28,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:28,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:28,786 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:28,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-11 11:55:28,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,788 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,788 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:28,788 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:28,788 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-11 11:55:28,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:28,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-11 11:55:28,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:28,788 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:28,788 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:28,788 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-11 11:55:28,788 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:28,788 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:28,788 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-11 11:55:28,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-11 11:55:28,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:28,788 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:28,789 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:28,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:28,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:28,889 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:28,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:28,890 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:28,890 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): 45cc680593870df452d4141fbb486a43/family1 is initiating major compaction (all files) 2023-11-11 11:55:28,890 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:55:28,890 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:55:28,890 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of 45cc680593870df452d4141fbb486a43/family1 in ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:28,890 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/584dd4596e7a4adf9327d4407fd212c9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/2ad7f19a25bc480191d42c1502fca721, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/475fb5f2ff1a4f4eab4a606f13504f97, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/3a868fba713540ab8137ebd37ecdbe19, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/d399f09f9f844b22b4f48ff15b1f3045] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp, totalSize=26.6 K 2023-11-11 11:55:28,891 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 584dd4596e7a4adf9327d4407fd212c9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703720709 2023-11-11 11:55:28,891 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 2ad7f19a25bc480191d42c1502fca721, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703722491 2023-11-11 11:55:28,892 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 475fb5f2ff1a4f4eab4a606f13504f97, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703724289 2023-11-11 11:55:28,892 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 3a868fba713540ab8137ebd37ecdbe19, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703726076 2023-11-11 11:55:28,892 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting d399f09f9f844b22b4f48ff15b1f3045, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 11:55:28,902 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): 45cc680593870df452d4141fbb486a43#family1#compaction#149 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:29,310 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231111a61319a47eea4d5faffa8fc53efa245b_del 2023-11-11 11:55:29,311 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111a61319a47eea4d5faffa8fc53efa245b_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231111a61319a47eea4d5faffa8fc53efa245b_del 2023-11-11 11:55:29,322 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80da15773a4b46dd9c28f0e33f10b71c 2023-11-11 11:55:29,323 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family1/80da15773a4b46dd9c28f0e33f10b71c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/80da15773a4b46dd9c28f0e33f10b71c 2023-11-11 11:55:29,326 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80da15773a4b46dd9c28f0e33f10b71c 2023-11-11 11:55:29,327 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 45cc680593870df452d4141fbb486a43/family1 of 45cc680593870df452d4141fbb486a43 into 80da15773a4b46dd9c28f0e33f10b71c(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:55:29,327 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for 45cc680593870df452d4141fbb486a43: 2023-11-11 11:55:29,327 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:29,327 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): 45cc680593870df452d4141fbb486a43/family2 is initiating major compaction (all files) 2023-11-11 11:55:29,328 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:55:29,328 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:55:29,328 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of 45cc680593870df452d4141fbb486a43/family2 in ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:55:29,328 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/a7ebf20fa3084adf96791c8a931503ef, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/c59fe61101a14f61a1894e750b24023a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/7aecc22f616f45df95b9dc1fd2dc4705, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/a02365af49d94dc391bdd6f826414a9b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/5e36aedab7a048c1bb3136682450bec2] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp, totalSize=25.3 K 2023-11-11 11:55:29,328 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting a7ebf20fa3084adf96791c8a931503ef, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703720709 2023-11-11 11:55:29,329 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting c59fe61101a14f61a1894e750b24023a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703722491 2023-11-11 11:55:29,329 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 7aecc22f616f45df95b9dc1fd2dc4705, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703724289 2023-11-11 11:55:29,329 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting a02365af49d94dc391bdd6f826414a9b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703726076 2023-11-11 11:55:29,330 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 5e36aedab7a048c1bb3136682450bec2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 11:55:29,338 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): 45cc680593870df452d4141fbb486a43#family2#compaction#150 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:29,344 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231111761ea9c029624205810a1be6505c3ed4_del 2023-11-11 11:55:29,345 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111761ea9c029624205810a1be6505c3ed4_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231111761ea9c029624205810a1be6505c3ed4_del 2023-11-11 11:55:29,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/584dd4596e7a4adf9327d4407fd212c9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/2ad7f19a25bc480191d42c1502fca721, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/475fb5f2ff1a4f4eab4a606f13504f97, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/3a868fba713540ab8137ebd37ecdbe19, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/d399f09f9f844b22b4f48ff15b1f3045] to archive 2023-11-11 11:55:29,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:29,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/584dd4596e7a4adf9327d4407fd212c9 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/584dd4596e7a4adf9327d4407fd212c9 2023-11-11 11:55:29,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/2ad7f19a25bc480191d42c1502fca721 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/2ad7f19a25bc480191d42c1502fca721 2023-11-11 11:55:29,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/475fb5f2ff1a4f4eab4a606f13504f97 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/475fb5f2ff1a4f4eab4a606f13504f97 2023-11-11 11:55:29,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/3a868fba713540ab8137ebd37ecdbe19 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/3a868fba713540ab8137ebd37ecdbe19 2023-11-11 11:55:29,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/d399f09f9f844b22b4f48ff15b1f3045 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/d399f09f9f844b22b4f48ff15b1f3045 2023-11-11 11:55:30,158 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 387be05b5d35481692c02898cc0cfdca 2023-11-11 11:55:30,158 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/.tmp/family2/387be05b5d35481692c02898cc0cfdca as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/387be05b5d35481692c02898cc0cfdca 2023-11-11 11:55:30,161 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 387be05b5d35481692c02898cc0cfdca 2023-11-11 11:55:30,162 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 45cc680593870df452d4141fbb486a43/family2 of 45cc680593870df452d4141fbb486a43 into 387be05b5d35481692c02898cc0cfdca(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:55:30,162 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for 45cc680593870df452d4141fbb486a43: 2023-11-11 11:55:30,162 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:30,163 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): c3c434dd053fdf95e98a3b778602f7ca/family1 is initiating major compaction (all files) 2023-11-11 11:55:30,163 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:55:30,163 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:55:30,164 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of c3c434dd053fdf95e98a3b778602f7ca/family1 in ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:30,164 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/fbc38a4dfc01499a9c83be049479ae1f, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/b62104a7989d428fb575e579912f112f, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/d21b5141bab44c8e8f055838cb7ea705, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/d753653ffbef4fd7852c7ef72a21a4d0, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/c557ea1415d846f6a1b2b652d6805a97] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp, totalSize=26.6 K 2023-11-11 11:55:30,164 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting fbc38a4dfc01499a9c83be049479ae1f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703720710 2023-11-11 11:55:30,164 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting b62104a7989d428fb575e579912f112f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703722492 2023-11-11 11:55:30,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/a7ebf20fa3084adf96791c8a931503ef, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/c59fe61101a14f61a1894e750b24023a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/7aecc22f616f45df95b9dc1fd2dc4705, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/a02365af49d94dc391bdd6f826414a9b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/5e36aedab7a048c1bb3136682450bec2] to archive 2023-11-11 11:55:30,165 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting d21b5141bab44c8e8f055838cb7ea705, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703724290 2023-11-11 11:55:30,165 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting d753653ffbef4fd7852c7ef72a21a4d0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703726076 2023-11-11 11:55:30,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:30,166 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting c557ea1415d846f6a1b2b652d6805a97, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 11:55:30,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/a7ebf20fa3084adf96791c8a931503ef to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/a7ebf20fa3084adf96791c8a931503ef 2023-11-11 11:55:30,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/c59fe61101a14f61a1894e750b24023a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/c59fe61101a14f61a1894e750b24023a 2023-11-11 11:55:30,169 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/7aecc22f616f45df95b9dc1fd2dc4705 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/7aecc22f616f45df95b9dc1fd2dc4705 2023-11-11 11:55:30,171 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/a02365af49d94dc391bdd6f826414a9b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/a02365af49d94dc391bdd6f826414a9b 2023-11-11 11:55:30,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/5e36aedab7a048c1bb3136682450bec2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family2/5e36aedab7a048c1bb3136682450bec2 2023-11-11 11:55:30,175 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): c3c434dd053fdf95e98a3b778602f7ca#family1#compaction#151 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:30,583 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311119375f1f4c56d4046869332f8ed19f18f_del 2023-11-11 11:55:30,583 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311119375f1f4c56d4046869332f8ed19f18f_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311119375f1f4c56d4046869332f8ed19f18f_del 2023-11-11 11:55:31,396 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f91a6ad4cba94cbe90a187c39a7d9aff 2023-11-11 11:55:31,396 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family1/f91a6ad4cba94cbe90a187c39a7d9aff as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/f91a6ad4cba94cbe90a187c39a7d9aff 2023-11-11 11:55:31,399 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f91a6ad4cba94cbe90a187c39a7d9aff 2023-11-11 11:55:31,400 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c3c434dd053fdf95e98a3b778602f7ca/family1 of c3c434dd053fdf95e98a3b778602f7ca into f91a6ad4cba94cbe90a187c39a7d9aff(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:55:31,400 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for c3c434dd053fdf95e98a3b778602f7ca: 2023-11-11 11:55:31,400 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:31,401 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): c3c434dd053fdf95e98a3b778602f7ca/family2 is initiating major compaction (all files) 2023-11-11 11:55:31,401 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:55:31,401 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:55:31,402 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of c3c434dd053fdf95e98a3b778602f7ca/family2 in ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:55:31,402 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/f6d6208418934d0189dc7241e2d2df16, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/78b62127481045829eb7c6ecb0133572, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/f59b6b22b327490da8f3235f9443e6c9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/25c75a85a21d47f4b9b5d9c3899491c6, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/9aefaf1a13f742ff83da118b31fbb081] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp, totalSize=25.3 K 2023-11-11 11:55:31,402 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting f6d6208418934d0189dc7241e2d2df16, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703720710 2023-11-11 11:55:31,402 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 78b62127481045829eb7c6ecb0133572, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703722492 2023-11-11 11:55:31,403 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting f59b6b22b327490da8f3235f9443e6c9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703724290 2023-11-11 11:55:31,403 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 25c75a85a21d47f4b9b5d9c3899491c6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703726076 2023-11-11 11:55:31,403 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 9aefaf1a13f742ff83da118b31fbb081, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 11:55:31,413 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): c3c434dd053fdf95e98a3b778602f7ca#family2#compaction#152 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:31,468 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/fbc38a4dfc01499a9c83be049479ae1f, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/b62104a7989d428fb575e579912f112f, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/d21b5141bab44c8e8f055838cb7ea705, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/d753653ffbef4fd7852c7ef72a21a4d0, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/c557ea1415d846f6a1b2b652d6805a97] to archive 2023-11-11 11:55:31,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:31,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/fbc38a4dfc01499a9c83be049479ae1f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/fbc38a4dfc01499a9c83be049479ae1f 2023-11-11 11:55:31,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/b62104a7989d428fb575e579912f112f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/b62104a7989d428fb575e579912f112f 2023-11-11 11:55:31,473 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/d21b5141bab44c8e8f055838cb7ea705 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/d21b5141bab44c8e8f055838cb7ea705 2023-11-11 11:55:31,474 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/d753653ffbef4fd7852c7ef72a21a4d0 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/d753653ffbef4fd7852c7ef72a21a4d0 2023-11-11 11:55:31,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/c557ea1415d846f6a1b2b652d6805a97 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/c557ea1415d846f6a1b2b652d6805a97 2023-11-11 11:55:31,825 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311119f2c581242d449429cc40140986db738_del 2023-11-11 11:55:31,825 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311119f2c581242d449429cc40140986db738_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311119f2c581242d449429cc40140986db738_del 2023-11-11 11:55:32,639 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 71be5cf2dd3241a5853c1165722957eb 2023-11-11 11:55:32,640 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/.tmp/family2/71be5cf2dd3241a5853c1165722957eb as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/71be5cf2dd3241a5853c1165722957eb 2023-11-11 11:55:32,644 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 71be5cf2dd3241a5853c1165722957eb 2023-11-11 11:55:32,645 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c3c434dd053fdf95e98a3b778602f7ca/family2 of c3c434dd053fdf95e98a3b778602f7ca into 71be5cf2dd3241a5853c1165722957eb(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:55:32,645 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for c3c434dd053fdf95e98a3b778602f7ca: 2023-11-11 11:55:32,645 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:32,645 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): 8cb9f02ad3781aa733fd732e5fe19945/family1 is initiating major compaction (all files) 2023-11-11 11:55:32,645 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:55:32,645 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:55:32,646 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of 8cb9f02ad3781aa733fd732e5fe19945/family1 in ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:32,646 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/10202a8a915b46598966e064a88e3f84, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/e90bb78560674d31b7f54db2bc59acf0, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/7d4dab61333b4ad39beaadde33dc7d94, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/0e1443c2d4d547b5ae9d15d8effedbb6, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/f57b010c3dd84fecb35178528bdb70f7] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp, totalSize=26.6 K 2023-11-11 11:55:32,647 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 10202a8a915b46598966e064a88e3f84, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703720710 2023-11-11 11:55:32,647 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting e90bb78560674d31b7f54db2bc59acf0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703722492 2023-11-11 11:55:32,648 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 7d4dab61333b4ad39beaadde33dc7d94, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703724290 2023-11-11 11:55:32,648 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 0e1443c2d4d547b5ae9d15d8effedbb6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703726076 2023-11-11 11:55:32,648 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting f57b010c3dd84fecb35178528bdb70f7, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 11:55:32,657 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): 8cb9f02ad3781aa733fd732e5fe19945#family1#compaction#153 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:32,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/f6d6208418934d0189dc7241e2d2df16, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/78b62127481045829eb7c6ecb0133572, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/f59b6b22b327490da8f3235f9443e6c9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/25c75a85a21d47f4b9b5d9c3899491c6, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/9aefaf1a13f742ff83da118b31fbb081] to archive 2023-11-11 11:55:32,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:32,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/f6d6208418934d0189dc7241e2d2df16 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/f6d6208418934d0189dc7241e2d2df16 2023-11-11 11:55:32,668 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/78b62127481045829eb7c6ecb0133572 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/78b62127481045829eb7c6ecb0133572 2023-11-11 11:55:32,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/f59b6b22b327490da8f3235f9443e6c9 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/f59b6b22b327490da8f3235f9443e6c9 2023-11-11 11:55:32,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/25c75a85a21d47f4b9b5d9c3899491c6 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/25c75a85a21d47f4b9b5d9c3899491c6 2023-11-11 11:55:32,671 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/9aefaf1a13f742ff83da118b31fbb081 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family2/9aefaf1a13f742ff83da118b31fbb081 2023-11-11 11:55:33,065 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231111d699ba12741f448192da33c7259a2065_del 2023-11-11 11:55:33,065 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111d699ba12741f448192da33c7259a2065_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231111d699ba12741f448192da33c7259a2065_del 2023-11-11 11:55:33,878 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for febd0ad2a3934662aaf459d303b308e4 2023-11-11 11:55:33,879 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family1/febd0ad2a3934662aaf459d303b308e4 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/febd0ad2a3934662aaf459d303b308e4 2023-11-11 11:55:33,883 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for febd0ad2a3934662aaf459d303b308e4 2023-11-11 11:55:33,884 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8cb9f02ad3781aa733fd732e5fe19945/family1 of 8cb9f02ad3781aa733fd732e5fe19945 into febd0ad2a3934662aaf459d303b308e4(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:55:33,884 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for 8cb9f02ad3781aa733fd732e5fe19945: 2023-11-11 11:55:33,884 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:33,884 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): 8cb9f02ad3781aa733fd732e5fe19945/family2 is initiating major compaction (all files) 2023-11-11 11:55:33,884 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:55:33,884 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:55:33,884 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of 8cb9f02ad3781aa733fd732e5fe19945/family2 in ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:55:33,884 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/c1991f3cea854498bf5db36f7cba2cbb, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/020143ecd5ae4e51a4861cd50a982e42, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/6888dcfb9c8c494ea59c29672c2f66e9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/fb6fc1a5c69b448ca24c73bbc658176e, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/938d3c88d9d9477ca5ddd31875dcad49] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp, totalSize=25.3 K 2023-11-11 11:55:33,885 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting c1991f3cea854498bf5db36f7cba2cbb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703720710 2023-11-11 11:55:33,885 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 020143ecd5ae4e51a4861cd50a982e42, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703722492 2023-11-11 11:55:33,886 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 6888dcfb9c8c494ea59c29672c2f66e9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703724290 2023-11-11 11:55:33,886 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting fb6fc1a5c69b448ca24c73bbc658176e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703726076 2023-11-11 11:55:33,887 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 938d3c88d9d9477ca5ddd31875dcad49, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 11:55:33,896 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): 8cb9f02ad3781aa733fd732e5fe19945#family2#compaction#154 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:33,904 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231111f0d351dc84a3493bb2feeafda66cd07c_del 2023-11-11 11:55:33,904 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111f0d351dc84a3493bb2feeafda66cd07c_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231111f0d351dc84a3493bb2feeafda66cd07c_del 2023-11-11 11:55:33,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/10202a8a915b46598966e064a88e3f84, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/e90bb78560674d31b7f54db2bc59acf0, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/7d4dab61333b4ad39beaadde33dc7d94, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/0e1443c2d4d547b5ae9d15d8effedbb6, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/f57b010c3dd84fecb35178528bdb70f7] to archive 2023-11-11 11:55:33,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:33,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/10202a8a915b46598966e064a88e3f84 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/10202a8a915b46598966e064a88e3f84 2023-11-11 11:55:33,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/e90bb78560674d31b7f54db2bc59acf0 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/e90bb78560674d31b7f54db2bc59acf0 2023-11-11 11:55:33,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/7d4dab61333b4ad39beaadde33dc7d94 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/7d4dab61333b4ad39beaadde33dc7d94 2023-11-11 11:55:33,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/0e1443c2d4d547b5ae9d15d8effedbb6 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/0e1443c2d4d547b5ae9d15d8effedbb6 2023-11-11 11:55:33,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/f57b010c3dd84fecb35178528bdb70f7 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/f57b010c3dd84fecb35178528bdb70f7 2023-11-11 11:55:34,719 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92a6f60e2c904f5caf784214dd36cd81 2023-11-11 11:55:34,719 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/.tmp/family2/92a6f60e2c904f5caf784214dd36cd81 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/92a6f60e2c904f5caf784214dd36cd81 2023-11-11 11:55:34,723 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92a6f60e2c904f5caf784214dd36cd81 2023-11-11 11:55:34,724 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8cb9f02ad3781aa733fd732e5fe19945/family2 of 8cb9f02ad3781aa733fd732e5fe19945 into 92a6f60e2c904f5caf784214dd36cd81(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:55:34,724 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for 8cb9f02ad3781aa733fd732e5fe19945: 2023-11-11 11:55:34,728 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:34,731 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:34,734 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:34,735 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:34,740 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-11 11:55:34,752 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-11 11:55:34,754 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231111a61319a47eea4d5faffa8fc53efa245b_del 2023-11-11 11:55:34,757 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231111d699ba12741f448192da33c7259a2065_del 2023-11-11 11:55:34,761 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311119375f1f4c56d4046869332f8ed19f18f_del 2023-11-11 11:55:34,761 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-11 11:55:34,762 DEBUG [Listener at localhost/39241] zookeeper.ReadOnlyZKClient(139): Connect 0x45ab772c to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:55:34,768 DEBUG [Listener at localhost/39241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@673b8103, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:55:34,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/c1991f3cea854498bf5db36f7cba2cbb, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/020143ecd5ae4e51a4861cd50a982e42, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/6888dcfb9c8c494ea59c29672c2f66e9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/fb6fc1a5c69b448ca24c73bbc658176e, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/938d3c88d9d9477ca5ddd31875dcad49] to archive 2023-11-11 11:55:34,770 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231111 for table='ns:testMinorCompaction' and column='family1' 2023-11-11 11:55:34,770 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231111 for table='ns:testMinorCompaction' and column='family1' 2023-11-11 11:55:34,770 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231111 for table='ns:testMinorCompaction' and column='family1' 2023-11-11 11:55:34,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:34,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/c1991f3cea854498bf5db36f7cba2cbb to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/c1991f3cea854498bf5db36f7cba2cbb 2023-11-11 11:55:34,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/020143ecd5ae4e51a4861cd50a982e42 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/020143ecd5ae4e51a4861cd50a982e42 2023-11-11 11:55:34,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/6888dcfb9c8c494ea59c29672c2f66e9 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/6888dcfb9c8c494ea59c29672c2f66e9 2023-11-11 11:55:34,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/fb6fc1a5c69b448ca24c73bbc658176e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/fb6fc1a5c69b448ca24c73bbc658176e 2023-11-11 11:55:34,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/938d3c88d9d9477ca5ddd31875dcad49 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family2/938d3c88d9d9477ca5ddd31875dcad49 2023-11-11 11:55:34,805 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111a8e53fb67aa642bc8ede420a93f54ca1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231111a8e53fb67aa642bc8ede420a93f54ca1 2023-11-11 11:55:34,806 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='ns:testMinorCompaction' column='family1' 2023-11-11 11:55:34,818 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:55:34,821 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:55:34,827 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:55:34,829 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:55:34,838 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/family1/5652314b964e4a6e9ce7ead8e6408d57 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-11 11:55:34,838 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/family1/5652314b964e4a6e9ce7ead8e6408d57}] 2023-11-11 11:55:34,842 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/family1/5652314b964e4a6e9ce7ead8e6408d57 for inclusion in 45cc680593870df452d4141fbb486a43/family1 2023-11-11 11:55:34,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-11 11:55:34,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last=1 2023-11-11 11:55:34,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 45cc680593870df452d4141fbb486a43: 2023-11-11 11:55:34,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231111/family1/5652314b964e4a6e9ce7ead8e6408d57 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__3mdvkttlptuvd14508rc3nmat31mut2r7n7atsd02cbcaqdn6su7hj4vj0nia27c/family1/5652314b964e4a6e9ce7ead8e6408d57 2023-11-11 11:55:34,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__3mdvkttlptuvd14508rc3nmat31mut2r7n7atsd02cbcaqdn6su7hj4vj0nia27c/family1/5652314b964e4a6e9ce7ead8e6408d57 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/66f3376d6a5d4d17b1bac0e02a160f28_SeqId_28_ 2023-11-11 11:55:34,847 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__3mdvkttlptuvd14508rc3nmat31mut2r7n7atsd02cbcaqdn6su7hj4vj0nia27c/family1/5652314b964e4a6e9ce7ead8e6408d57 into 45cc680593870df452d4141fbb486a43/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/66f3376d6a5d4d17b1bac0e02a160f28_SeqId_28_ - updating store file list. 2023-11-11 11:55:34,850 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/66f3376d6a5d4d17b1bac0e02a160f28_SeqId_28_ into 45cc680593870df452d4141fbb486a43/family1 2023-11-11 11:55:34,850 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__3mdvkttlptuvd14508rc3nmat31mut2r7n7atsd02cbcaqdn6su7hj4vj0nia27c/family1/5652314b964e4a6e9ce7ead8e6408d57 into 45cc680593870df452d4141fbb486a43/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/family1/66f3376d6a5d4d17b1bac0e02a160f28_SeqId_28_) 2023-11-11 11:55:34,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__3mdvkttlptuvd14508rc3nmat31mut2r7n7atsd02cbcaqdn6su7hj4vj0nia27c/family1/5652314b964e4a6e9ce7ead8e6408d57 2023-11-11 11:55:34,852 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='ns:testMinorCompaction' column='family1' 2023-11-11 11:55:34,853 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:34,854 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231111cc587eab790147269361db1d5029d731 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231111cc587eab790147269361db1d5029d731 2023-11-11 11:55:34,854 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-11 11:55:34,854 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231111' 2023-11-11 11:55:34,855 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231111 for table='ns:testMinorCompaction' and column='family1' 2023-11-11 11:55:35,599 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311118ed697f1ef5848d9b3539d6971ee96ee to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311118ed697f1ef5848d9b3539d6971ee96ee 2023-11-11 11:55:35,600 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='ns:testMinorCompaction' column='family1' 2023-11-11 11:55:35,605 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111c27bc5282d124681aba3816fadf5e514 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231111c27bc5282d124681aba3816fadf5e514 2023-11-11 11:55:35,606 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='ns:testMinorCompaction' column='family1' 2023-11-11 11:55:35,622 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231111/family1/97ab1bfa99784375b86f694bedc243f1 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-11 11:55:35,622 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231111/family1/97ab1bfa99784375b86f694bedc243f1}] 2023-11-11 11:55:35,624 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231111/family1/97ab1bfa99784375b86f694bedc243f1 for inclusion in 8cb9f02ad3781aa733fd732e5fe19945/family1 2023-11-11 11:55:35,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-11 11:55:35,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-11 11:55:35,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 8cb9f02ad3781aa733fd732e5fe19945: 2023-11-11 11:55:35,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231111/family1/97ab1bfa99784375b86f694bedc243f1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__6g29n6pa50qcs9apopkh8db1uho4tj4ue8lmvu8ti6bp1naij2rthi2k1rdo7p15/family1/97ab1bfa99784375b86f694bedc243f1 2023-11-11 11:55:35,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__6g29n6pa50qcs9apopkh8db1uho4tj4ue8lmvu8ti6bp1naij2rthi2k1rdo7p15/family1/97ab1bfa99784375b86f694bedc243f1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/64cc06824e3449a282f2f86cbeae2708_SeqId_28_ 2023-11-11 11:55:35,629 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__6g29n6pa50qcs9apopkh8db1uho4tj4ue8lmvu8ti6bp1naij2rthi2k1rdo7p15/family1/97ab1bfa99784375b86f694bedc243f1 into 8cb9f02ad3781aa733fd732e5fe19945/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/64cc06824e3449a282f2f86cbeae2708_SeqId_28_ - updating store file list. 2023-11-11 11:55:35,632 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/64cc06824e3449a282f2f86cbeae2708_SeqId_28_ into 8cb9f02ad3781aa733fd732e5fe19945/family1 2023-11-11 11:55:35,632 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__6g29n6pa50qcs9apopkh8db1uho4tj4ue8lmvu8ti6bp1naij2rthi2k1rdo7p15/family1/97ab1bfa99784375b86f694bedc243f1 into 8cb9f02ad3781aa733fd732e5fe19945/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/family1/64cc06824e3449a282f2f86cbeae2708_SeqId_28_) 2023-11-11 11:55:35,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__6g29n6pa50qcs9apopkh8db1uho4tj4ue8lmvu8ti6bp1naij2rthi2k1rdo7p15/family1/97ab1bfa99784375b86f694bedc243f1 2023-11-11 11:55:35,634 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='ns:testMinorCompaction' column='family1' 2023-11-11 11:55:35,635 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231111/family1/026d1f975bc240fd8dd6b2c4152bb934 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-11 11:55:35,635 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231111/family1/026d1f975bc240fd8dd6b2c4152bb934}] 2023-11-11 11:55:35,635 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:35,637 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311115a38b83028f042ef90678bd5641f0ca2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311115a38b83028f042ef90678bd5641f0ca2 2023-11-11 11:55:35,637 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-11 11:55:35,637 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231111' 2023-11-11 11:55:35,637 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231111/family1/026d1f975bc240fd8dd6b2c4152bb934 for inclusion in c3c434dd053fdf95e98a3b778602f7ca/family1 2023-11-11 11:55:35,637 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231111 for table='ns:testMinorCompaction' and column='family1' 2023-11-11 11:55:35,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-11 11:55:35,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-11 11:55:35,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for c3c434dd053fdf95e98a3b778602f7ca: 2023-11-11 11:55:35,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231111/family1/026d1f975bc240fd8dd6b2c4152bb934 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__bhtradtkg4859bp09ef3h11qutoc2vofnk5m2n6hhl6qrm8qgegahlh28h9f4c1i/family1/026d1f975bc240fd8dd6b2c4152bb934 2023-11-11 11:55:35,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__bhtradtkg4859bp09ef3h11qutoc2vofnk5m2n6hhl6qrm8qgegahlh28h9f4c1i/family1/026d1f975bc240fd8dd6b2c4152bb934 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/9a9021199b1644f58e58a4bb5f95fb10_SeqId_28_ 2023-11-11 11:55:35,642 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__bhtradtkg4859bp09ef3h11qutoc2vofnk5m2n6hhl6qrm8qgegahlh28h9f4c1i/family1/026d1f975bc240fd8dd6b2c4152bb934 into c3c434dd053fdf95e98a3b778602f7ca/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/9a9021199b1644f58e58a4bb5f95fb10_SeqId_28_ - updating store file list. 2023-11-11 11:55:35,645 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/9a9021199b1644f58e58a4bb5f95fb10_SeqId_28_ into c3c434dd053fdf95e98a3b778602f7ca/family1 2023-11-11 11:55:35,645 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__bhtradtkg4859bp09ef3h11qutoc2vofnk5m2n6hhl6qrm8qgegahlh28h9f4c1i/family1/026d1f975bc240fd8dd6b2c4152bb934 into c3c434dd053fdf95e98a3b778602f7ca/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/family1/9a9021199b1644f58e58a4bb5f95fb10_SeqId_28_) 2023-11-11 11:55:35,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__ns_testMinorCompaction__bhtradtkg4859bp09ef3h11qutoc2vofnk5m2n6hhl6qrm8qgegahlh28h9f4c1i/family1/026d1f975bc240fd8dd6b2c4152bb934 2023-11-11 11:55:35,647 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='ns:testMinorCompaction' column='family1' 2023-11-11 11:55:35,647 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:35,648 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231111d2096e71644d4bf3b5545cbf547fd10b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231111d2096e71644d4bf3b5545cbf547fd10b 2023-11-11 11:55:35,648 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-11 11:55:35,649 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231111' 2023-11-11 11:55:35,649 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231111 for table='ns:testMinorCompaction' and column='family1' 2023-11-11 11:55:35,649 INFO [Listener at localhost/39241] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-11 11:55:35,651 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:35,653 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:35,655 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:35,656 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:35,673 INFO [Listener at localhost/39241] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=249 (was 285), OpenFileDescriptor=651 (was 782), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=126 (was 136), ProcessCount=170 (was 170), AvailableMemoryMB=2433 (was 2300) - AvailableMemoryMB LEAK? - 2023-11-11 11:55:35,685 INFO [Listener at localhost/39241] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=249, OpenFileDescriptor=651, MaxFileDescriptor=60000, SystemLoadAverage=126, ProcessCount=170, AvailableMemoryMB=2432 2023-11-11 11:55:35,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-11 11:55:35,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:35,688 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 11:55:35,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-11 11:55:35,689 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 11:55:35,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-11 11:55:35,690 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04 2023-11-11 11:55:35,691 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04 empty. 2023-11-11 11:55:35,691 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04 2023-11-11 11:55:35,691 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-11 11:55:35,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-11 11:55:35,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-11 11:55:36,097 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-11 11:55:36,099 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 147870233aed417eedc1252d62affc04, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:55:36,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-11 11:55:36,504 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:36,504 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 147870233aed417eedc1252d62affc04, disabling compactions & flushes 2023-11-11 11:55:36,504 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:36,504 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:36,504 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. after waiting 0 ms 2023-11-11 11:55:36,504 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:36,504 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:36,504 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:36,506 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 11:55:36,507 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699703736507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703736507"}]},"ts":"1699703736507"} 2023-11-11 11:55:36,509 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-11 11:55:36,509 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 11:55:36,509 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703736509"}]},"ts":"1699703736509"} 2023-11-11 11:55:36,510 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-11 11:55:36,517 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=147870233aed417eedc1252d62affc04, ASSIGN}] 2023-11-11 11:55:36,519 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=147870233aed417eedc1252d62affc04, ASSIGN 2023-11-11 11:55:36,519 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=147870233aed417eedc1252d62affc04, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:55:36,670 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=147870233aed417eedc1252d62affc04, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:36,671 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699703736670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703736670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703736670"}]},"ts":"1699703736670"} 2023-11-11 11:55:36,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 147870233aed417eedc1252d62affc04, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:55:36,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-11 11:55:36,823 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:36,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:36,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 147870233aed417eedc1252d62affc04, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04.', STARTKEY => '', ENDKEY => ''} 2023-11-11 11:55:36,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 147870233aed417eedc1252d62affc04 2023-11-11 11:55:36,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:36,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 147870233aed417eedc1252d62affc04 2023-11-11 11:55:36,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 147870233aed417eedc1252d62affc04 2023-11-11 11:55:36,827 INFO [StoreOpener-147870233aed417eedc1252d62affc04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 147870233aed417eedc1252d62affc04 2023-11-11 11:55:36,829 DEBUG [StoreOpener-147870233aed417eedc1252d62affc04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1 2023-11-11 11:55:36,829 DEBUG [StoreOpener-147870233aed417eedc1252d62affc04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1 2023-11-11 11:55:36,829 INFO [StoreOpener-147870233aed417eedc1252d62affc04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 147870233aed417eedc1252d62affc04 columnFamilyName family1 2023-11-11 11:55:36,830 INFO [StoreOpener-147870233aed417eedc1252d62affc04-1] regionserver.HStore(310): Store=147870233aed417eedc1252d62affc04/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:36,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04 2023-11-11 11:55:36,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04 2023-11-11 11:55:36,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 147870233aed417eedc1252d62affc04 2023-11-11 11:55:36,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:55:36,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 147870233aed417eedc1252d62affc04; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63788282, jitterRate=-0.04948052763938904}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-11 11:55:36,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:36,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04., pid=114, masterSystemTime=1699703736823 2023-11-11 11:55:36,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:36,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:36,838 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=147870233aed417eedc1252d62affc04, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:36,839 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699703736838"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703736838"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703736838"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703736838"}]},"ts":"1699703736838"} 2023-11-11 11:55:36,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-11 11:55:36,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 147870233aed417eedc1252d62affc04, server=jenkins-hbase4.apache.org,41363,1699703601801 in 168 msec 2023-11-11 11:55:36,842 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-11 11:55:36,842 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=147870233aed417eedc1252d62affc04, ASSIGN in 324 msec 2023-11-11 11:55:36,842 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 11:55:36,842 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703736842"}]},"ts":"1699703736842"} 2023-11-11 11:55:36,843 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-11 11:55:36,845 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 11:55:36,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1580 sec 2023-11-11 11:55:37,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-11 11:55:37,795 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-11 11:55:37,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:37,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:37,815 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:37,815 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:37,815 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:55:37,815 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:55:37,816 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:37,816 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:37,817 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:37,817 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:37,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:37,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:37,817 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:37,817 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:37,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:37,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:37,818 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:37,829 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:37,829 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:55:37,829 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:37,829 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:55:37,830 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:55:37,830 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:37,830 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:37,830 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. started... 2023-11-11 11:55:37,830 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 147870233aed417eedc1252d62affc04 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-11 11:55:38,252 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130479b87396ff2485891301ba6b64ee491 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130479b87396ff2485891301ba6b64ee491 2023-11-11 11:55:38,255 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/b43bc05dfd4448088257368e57a52dd4 2023-11-11 11:55:38,259 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/b43bc05dfd4448088257368e57a52dd4 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/b43bc05dfd4448088257368e57a52dd4 2023-11-11 11:55:38,262 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/b43bc05dfd4448088257368e57a52dd4, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-11 11:55:38,263 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 147870233aed417eedc1252d62affc04 in 433ms, sequenceid=5, compaction requested=false 2023-11-11 11:55:38,263 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:38,264 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:38,264 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:38,264 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:55:38,264 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:55:38,264 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,264 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:55:38,264 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:55:38,268 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,268 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:38,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:38,268 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,268 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:38,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:38,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:38,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:38,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:55:38,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@682b7cd0[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:38,270 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:55:38,270 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,271 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,271 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:55:38,271 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:55:38,271 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:38,272 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,272 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:38,272 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,272 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:55:38,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:38,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:38,272 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:38,273 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:55:38,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:38,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:38,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:38,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:38,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:55:38,275 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:55:38,275 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:38,275 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:38,275 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,275 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:38,277 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,277 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,277 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:38,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:38,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:38,278 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:38,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,281 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:38,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,285 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:38,285 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:38,285 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:38,285 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:38,285 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:38,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:38,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:38,285 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,285 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,285 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,286 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,286 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,286 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:38,286 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:38,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:38,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:38,386 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:38,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:38,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:38,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:38,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,392 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:38,392 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:38,392 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:55:38,392 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:55:38,392 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,393 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,394 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:38,394 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:38,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:38,394 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:38,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,394 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:38,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:38,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,395 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,395 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:55:38,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:38,395 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:55:38,395 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:38,395 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:55:38,395 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:55:38,395 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:38,396 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:38,396 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. started... 2023-11-11 11:55:38,396 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 147870233aed417eedc1252d62affc04 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-11 11:55:38,806 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f4a93e48592b4330b3c9b1addaab7660 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128f4a93e48592b4330b3c9b1addaab7660 2023-11-11 11:55:39,211 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/2b10b15283ba439c8d5c5ad10e5546ed 2023-11-11 11:55:39,215 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/2b10b15283ba439c8d5c5ad10e5546ed as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/2b10b15283ba439c8d5c5ad10e5546ed 2023-11-11 11:55:39,218 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/2b10b15283ba439c8d5c5ad10e5546ed, entries=1, sequenceid=9, filesize=5.0 K 2023-11-11 11:55:39,219 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 147870233aed417eedc1252d62affc04 in 823ms, sequenceid=9, compaction requested=false 2023-11-11 11:55:39,220 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:39,220 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:39,220 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:55:39,220 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:55:39,220 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,220 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:55:39,220 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:55:39,222 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,222 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:39,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:39,222 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,222 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:39,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:39,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:39,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:39,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:55:39,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5440385[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:39,224 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:55:39,224 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,225 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,225 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:55:39,225 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:55:39,225 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:39,225 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,225 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:39,227 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:55:39,227 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,227 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:39,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:39,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:39,227 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:55:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:39,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:55:39,230 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:55:39,230 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:39,230 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:39,230 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,230 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:39,231 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,231 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:39,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,231 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:39,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:39,232 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:39,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,233 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:39,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,235 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,235 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:39,235 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:39,235 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:39,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 11:55:39,235 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:39,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:39,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:39,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:39,235 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,235 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,235 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,235 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,235 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,235 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:39,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:39,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:39,236 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:39,336 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:39,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:39,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:39,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:39,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,342 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:39,342 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:39,342 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:55:39,342 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:55:39,342 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,342 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,343 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,343 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:39,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:39,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:39,344 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:39,344 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:39,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:39,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,345 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,345 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:55:39,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:39,345 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:55:39,345 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:39,345 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:55:39,345 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:55:39,345 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:39,345 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:39,345 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. started... 2023-11-11 11:55:39,346 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 147870233aed417eedc1252d62affc04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:55:39,756 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120136f212286788476091df60aa7aa6a2f8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120136f212286788476091df60aa7aa6a2f8 2023-11-11 11:55:40,161 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/67937881ffb5403ba479d121b85693d9 2023-11-11 11:55:40,165 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/67937881ffb5403ba479d121b85693d9 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/67937881ffb5403ba479d121b85693d9 2023-11-11 11:55:40,169 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/67937881ffb5403ba479d121b85693d9, entries=1, sequenceid=13, filesize=4.9 K 2023-11-11 11:55:40,169 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 147870233aed417eedc1252d62affc04 in 823ms, sequenceid=13, compaction requested=true 2023-11-11 11:55:40,170 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:40,170 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:40,170 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:55:40,170 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:55:40,170 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,170 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:55:40,170 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:55:40,172 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,172 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:40,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:40,173 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,173 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:40,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:40,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:40,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:40,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:55:40,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cd866e1[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:40,174 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:55:40,174 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,175 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,175 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:55:40,175 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:55:40,175 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:40,176 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,176 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:40,177 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,177 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:55:40,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:40,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:40,177 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:40,177 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:55:40,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:40,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:40,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:40,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:40,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:55:40,179 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:55:40,179 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:40,179 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:40,179 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,179 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:40,181 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,181 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,181 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:40,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:40,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:40,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:40,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:40,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:40,182 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:40,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,183 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:40,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,189 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,189 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:40,189 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,189 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:40,189 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,189 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:40,189 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:40,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:40,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:40,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:40,189 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,189 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,189 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,189 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:40,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:40,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:40,190 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:40,290 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:40,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:40,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:40,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:40,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,295 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:40,296 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:40,296 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:55:40,296 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:55:40,296 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,296 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,297 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:40,297 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:40,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:40,298 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:40,298 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:40,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:40,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,298 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,298 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:55:40,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:40,299 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:55:40,299 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:40,299 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:55:40,299 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:55:40,299 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:40,299 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:40,299 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. started... 2023-11-11 11:55:40,299 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 147870233aed417eedc1252d62affc04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:55:40,709 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120588bd13a32a71412ca1633ea514503b1a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120588bd13a32a71412ca1633ea514503b1a 2023-11-11 11:55:41,114 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/3e49141005854b7eb8305b641a89cec6 2023-11-11 11:55:41,119 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/3e49141005854b7eb8305b641a89cec6 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/3e49141005854b7eb8305b641a89cec6 2023-11-11 11:55:41,124 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/3e49141005854b7eb8305b641a89cec6, entries=1, sequenceid=17, filesize=4.9 K 2023-11-11 11:55:41,125 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 147870233aed417eedc1252d62affc04 in 826ms, sequenceid=17, compaction requested=true 2023-11-11 11:55:41,125 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:41,125 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:41,125 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:55:41,125 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:55:41,125 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,125 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:55:41,125 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:55:41,127 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,127 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:41,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:41,127 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,127 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:41,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:41,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:41,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:41,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:55:41,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70ec154f[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:41,129 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:55:41,129 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,130 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:55:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:55:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:41,130 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,131 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:41,132 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,132 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:55:41,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:41,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:41,132 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:41,132 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:55:41,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:41,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:41,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:41,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:55:41,135 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:55:41,135 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:41,135 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:41,135 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,135 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:41,138 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,138 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,138 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:41,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:41,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:41,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:41,138 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:41,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:41,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:41,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,140 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:41,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,142 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,142 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:41,142 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:41,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:41,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 11:55:41,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:41,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:41,142 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:41,142 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,142 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:41,143 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:41,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:41,143 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,143 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,143 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,143 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:41,143 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:41,243 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:41,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:41,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:41,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:41,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,249 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:41,249 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:41,249 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:55:41,249 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:55:41,249 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,249 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,251 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,251 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:41,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:41,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:41,251 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:41,251 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:41,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:41,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,252 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,252 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:55:41,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:41,252 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:55:41,252 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:41,252 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:55:41,252 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:55:41,252 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:41,252 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:41,252 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. started... 2023-11-11 11:55:41,252 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 147870233aed417eedc1252d62affc04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:55:41,663 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122826def0cf59864615bb90d1d9396c0721 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122826def0cf59864615bb90d1d9396c0721 2023-11-11 11:55:42,068 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/325d1f4c41c740a4b8e5361200ec453c 2023-11-11 11:55:42,072 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/325d1f4c41c740a4b8e5361200ec453c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/325d1f4c41c740a4b8e5361200ec453c 2023-11-11 11:55:42,075 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/325d1f4c41c740a4b8e5361200ec453c, entries=1, sequenceid=21, filesize=4.9 K 2023-11-11 11:55:42,076 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 147870233aed417eedc1252d62affc04 in 824ms, sequenceid=21, compaction requested=true 2023-11-11 11:55:42,076 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:42,076 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:55:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:55:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:55:42,076 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:55:42,078 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,078 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:42,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:42,078 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,078 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:42,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:42,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:42,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:42,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:55:42,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43922a7e[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:42,080 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:55:42,080 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,082 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,082 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:55:42,082 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:55:42,082 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:42,082 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,082 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:42,083 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:55:42,083 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:42,083 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,083 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:55:42,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:42,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:42,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:42,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:42,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:42,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:42,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:55:42,086 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:55:42,086 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:42,086 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:42,086 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,086 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:42,087 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,087 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,087 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:42,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:42,088 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,089 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:42,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,091 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,091 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,091 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:42,091 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,091 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:42,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:42,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:42,091 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:42,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:42,091 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:42,091 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 11:55:42,091 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,092 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:42,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:42,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:42,092 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,092 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:42,192 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:42,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:42,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:42,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:42,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,198 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:42,198 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:42,198 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:55:42,198 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:55:42,199 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,199 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,201 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:42,201 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:42,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:42,201 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,201 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:42,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:42,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,202 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,202 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:55:42,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,202 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:55:42,202 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:42,202 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:55:42,202 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:55:42,202 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:42,202 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:42,203 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. started... 2023-11-11 11:55:42,203 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 147870233aed417eedc1252d62affc04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:55:42,376 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 11:55:42,614 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123188ba7729d7c64427a621b34e135a21f6 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123188ba7729d7c64427a621b34e135a21f6 2023-11-11 11:55:42,619 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/816eb17be789458ea55ffd44218fb23c 2023-11-11 11:55:42,623 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/816eb17be789458ea55ffd44218fb23c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/816eb17be789458ea55ffd44218fb23c 2023-11-11 11:55:42,626 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/816eb17be789458ea55ffd44218fb23c, entries=1, sequenceid=25, filesize=4.9 K 2023-11-11 11:55:42,627 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 147870233aed417eedc1252d62affc04 in 424ms, sequenceid=25, compaction requested=true 2023-11-11 11:55:42,627 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:42,627 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:42,627 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:55:42,627 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:55:42,627 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,627 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:55:42,627 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:55:42,629 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,629 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:42,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:42,630 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,630 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:42,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:42,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:42,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:42,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:55:42,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66ef41a2[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:42,631 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:55:42,631 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,632 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,633 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:55:42,633 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:55:42,633 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:42,633 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,633 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:42,638 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,638 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:55:42,638 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:42,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:42,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:42,638 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:55:42,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:42,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:42,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:42,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:55:42,640 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:55:42,641 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:42,641 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:42,641 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,641 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:42,642 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,642 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:42,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,642 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:42,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:42,643 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:42,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,644 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:42,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,646 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,646 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:42,646 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:42,646 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:42,646 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,646 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:42,646 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:42,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:42,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:42,646 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,647 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,647 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,647 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:42,647 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:42,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:42,747 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:42,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:42,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:42,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:42,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,753 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:42,753 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:42,753 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:55:42,753 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:55:42,754 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,754 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,755 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:42,755 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:42,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:42,756 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:42,756 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:42,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:42,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,756 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,757 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:55:42,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:42,757 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:55:42,757 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:42,757 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:55:42,761 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:55:42,761 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:42,761 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:42,761 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. started... 2023-11-11 11:55:42,761 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 147870233aed417eedc1252d62affc04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:55:43,172 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601011e5f061087e44a7897ddc6bfbb6527a2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601011e5f061087e44a7897ddc6bfbb6527a2 2023-11-11 11:55:43,576 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/d1c5921e4e7a4d9b9d946bcd245c4781 2023-11-11 11:55:43,580 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/d1c5921e4e7a4d9b9d946bcd245c4781 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/d1c5921e4e7a4d9b9d946bcd245c4781 2023-11-11 11:55:43,583 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/d1c5921e4e7a4d9b9d946bcd245c4781, entries=1, sequenceid=29, filesize=4.9 K 2023-11-11 11:55:43,584 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 147870233aed417eedc1252d62affc04 in 823ms, sequenceid=29, compaction requested=true 2023-11-11 11:55:43,584 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:43,584 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:43,584 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:55:43,584 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:55:43,584 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,584 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:55:43,584 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:55:43,587 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,587 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:43,587 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,587 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:43,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:43,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:55:43,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59bfdcf0[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:43,588 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:55:43,589 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,590 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,590 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:55:43,590 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:55:43,590 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:43,590 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,590 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:43,591 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,591 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:55:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:43,591 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:43,591 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:55:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:43,594 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:55:43,594 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:43,594 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:43,594 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,594 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:43,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:55:43,595 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,595 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:43,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:43,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,595 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:43,596 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,597 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,600 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,600 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,600 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:43,600 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:43,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:43,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 11:55:43,600 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,600 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:43,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:43,600 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:43,600 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,600 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:43,600 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,600 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:43,600 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:43,701 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:43,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:43,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:43,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:43,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,706 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:43,706 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:43,706 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:55:43,706 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:55:43,707 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,707 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,708 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,708 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:43,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:43,708 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:43,708 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:43,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,709 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,709 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:55:43,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:43,709 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:55:43,709 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:43,709 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:55:43,710 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:55:43,710 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:43,710 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:43,710 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. started... 2023-11-11 11:55:43,710 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 147870233aed417eedc1252d62affc04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:55:43,719 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010387096698611445f99a6137204c37b4e8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010387096698611445f99a6137204c37b4e8 2023-11-11 11:55:44,124 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/43ef03eed77e4740988197fad850ccaf 2023-11-11 11:55:44,128 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/43ef03eed77e4740988197fad850ccaf as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/43ef03eed77e4740988197fad850ccaf 2023-11-11 11:55:44,132 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/43ef03eed77e4740988197fad850ccaf, entries=1, sequenceid=33, filesize=4.9 K 2023-11-11 11:55:44,133 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 147870233aed417eedc1252d62affc04 in 423ms, sequenceid=33, compaction requested=true 2023-11-11 11:55:44,133 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:44,133 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:44,133 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:55:44,133 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:55:44,133 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,133 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:55:44,133 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:55:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,135 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:44,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:55:44,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49e9fce5[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:44,136 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:55:44,136 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,137 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,138 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:55:44,138 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:55:44,138 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,138 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:44,138 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:44,143 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,143 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:55:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:44,143 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:44,143 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:55:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:44,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:44,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:55:44,146 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:55:44,146 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:44,146 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:44,146 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,146 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:44,147 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,147 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:44,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:44,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,147 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:44,148 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:44,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,149 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,151 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,151 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,151 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,151 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,151 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:44,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 11:55:44,151 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:44,151 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,151 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:44,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:44,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:44,151 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:44,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:44,152 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,152 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:44,152 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:44,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:44,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:44,252 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:44,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:44,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:44,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:44,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,258 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:44,258 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:44,258 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:55:44,258 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:55:44,258 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,258 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,259 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,259 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:44,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:44,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:44,260 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:44,260 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:44,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:44,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,261 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,261 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:55:44,261 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:44,261 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:55:44,261 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:44,261 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:55:44,261 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:55:44,261 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:44,261 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:44,261 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. started... 2023-11-11 11:55:44,261 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 147870233aed417eedc1252d62affc04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:55:44,672 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c549e6e5eb5d44d79c9720cd0c645e15 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907c549e6e5eb5d44d79c9720cd0c645e15 2023-11-11 11:55:45,077 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/26b09e1fae7742a59f9c917f6d503330 2023-11-11 11:55:45,081 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/26b09e1fae7742a59f9c917f6d503330 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/26b09e1fae7742a59f9c917f6d503330 2023-11-11 11:55:45,084 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/26b09e1fae7742a59f9c917f6d503330, entries=1, sequenceid=37, filesize=4.9 K 2023-11-11 11:55:45,084 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 147870233aed417eedc1252d62affc04 in 823ms, sequenceid=37, compaction requested=true 2023-11-11 11:55:45,084 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:45,084 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:45,084 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:55:45,085 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:55:45,085 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,085 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:55:45,085 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:55:45,089 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,089 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:45,090 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,090 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:45,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:55:45,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b7aee7c[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:45,091 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:55:45,091 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,092 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,092 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:55:45,093 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:55:45,093 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:45,093 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,093 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:45,094 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:55:45,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:45,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:55:45,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:45,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:45,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:45,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:45,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:55:45,096 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:55:45,096 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:45,096 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:45,096 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,096 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:45,098 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,098 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:45,098 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:45,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:45,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:45,099 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,100 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:45,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,103 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,103 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:45,103 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:45,103 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,103 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:45,103 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:45,103 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:45,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:45,103 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,103 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,103 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,104 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:45,104 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:45,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:45,204 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:45,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:45,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:45,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:45,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,210 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:45,210 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:45,210 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-11 11:55:45,210 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-11 11:55:45,210 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,210 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,211 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,211 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:45,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:45,212 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:45,212 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,212 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,213 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-11 11:55:45,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:45,213 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-11 11:55:45,213 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:45,213 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-11 11:55:45,213 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-11 11:55:45,213 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:45,213 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:45,213 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. started... 2023-11-11 11:55:45,213 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 147870233aed417eedc1252d62affc04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-11 11:55:45,624 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c635003ae023441aaa7793cbdb4d8a3b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120c635003ae023441aaa7793cbdb4d8a3b 2023-11-11 11:55:46,029 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/9174acd67e0149899df795bda5e31585 2023-11-11 11:55:46,033 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/9174acd67e0149899df795bda5e31585 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/9174acd67e0149899df795bda5e31585 2023-11-11 11:55:46,037 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/9174acd67e0149899df795bda5e31585, entries=1, sequenceid=41, filesize=4.9 K 2023-11-11 11:55:46,037 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 147870233aed417eedc1252d62affc04 in 824ms, sequenceid=41, compaction requested=true 2023-11-11 11:55:46,038 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:46,038 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-11 11:55:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-11 11:55:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-11 11:55:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-11 11:55:46,039 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,039 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:46,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:46,040 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,040 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:46,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:46,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:46,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:46,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-11 11:55:46,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7045ee0[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:46,041 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-11 11:55:46,041 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,042 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,043 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-11 11:55:46,043 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-11 11:55:46,043 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:46,043 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,043 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-11 11:55:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:46,045 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-11 11:55:46,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:46,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:46,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:46,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:46,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:46,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:46,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-11 11:55:46,048 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-11 11:55:46,048 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:46,048 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:46,048 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,048 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:46,050 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,050 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:46,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:46,050 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:46,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,050 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:46,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:46,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:46,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:46,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,051 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,054 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,054 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:46,054 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:46,054 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:46,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:46,054 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:46,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-11 11:55:46,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:46,054 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,054 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:46,054 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:46,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:46,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-11 11:55:46,054 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,054 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:46,054 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:46,054 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,155 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:46,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:46,156 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-11 11:55:46,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 11:55:46,159 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 11:55:46,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:55:46,159 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704346159 2023-11-11 11:55:46,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-11 11:55:46,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-11 11:55:46,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:55:46,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x7468ea17 to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:55:46,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18b1021d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:55:46,166 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:55:46,992 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cf06fadf91f74027a2eb595a09c09856 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103cf06fadf91f74027a2eb595a09c09856 2023-11-11 11:55:46,993 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:55:47,006 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:55:47,008 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:55:47,014 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:55:47,015 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:55:47,023 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/84690772804a4fe68e33a0f834348443 first=Optional[r5] last=Optional[r6] 2023-11-11 11:55:47,023 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/84690772804a4fe68e33a0f834348443}] 2023-11-11 11:55:47,028 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/84690772804a4fe68e33a0f834348443 for inclusion in 147870233aed417eedc1252d62affc04/family1 2023-11-11 11:55:47,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-11 11:55:47,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:55:47,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:47,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/84690772804a4fe68e33a0f834348443 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hepu5osb0n8cun2gr6vt5stl5c37u2tep8cpcsrb2ipr84sj8t29ffkf225jba06/family1/84690772804a4fe68e33a0f834348443 2023-11-11 11:55:47,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hepu5osb0n8cun2gr6vt5stl5c37u2tep8cpcsrb2ipr84sj8t29ffkf225jba06/family1/84690772804a4fe68e33a0f834348443 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/ce655fb07c9c4cd385fc3c65e6770ad8_SeqId_44_ 2023-11-11 11:55:47,036 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hepu5osb0n8cun2gr6vt5stl5c37u2tep8cpcsrb2ipr84sj8t29ffkf225jba06/family1/84690772804a4fe68e33a0f834348443 into 147870233aed417eedc1252d62affc04/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/ce655fb07c9c4cd385fc3c65e6770ad8_SeqId_44_ - updating store file list. 2023-11-11 11:55:47,039 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/ce655fb07c9c4cd385fc3c65e6770ad8_SeqId_44_ into 147870233aed417eedc1252d62affc04/family1 2023-11-11 11:55:47,039 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hepu5osb0n8cun2gr6vt5stl5c37u2tep8cpcsrb2ipr84sj8t29ffkf225jba06/family1/84690772804a4fe68e33a0f834348443 into 147870233aed417eedc1252d62affc04/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/ce655fb07c9c4cd385fc3c65e6770ad8_SeqId_44_) 2023-11-11 11:55:47,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__hepu5osb0n8cun2gr6vt5stl5c37u2tep8cpcsrb2ipr84sj8t29ffkf225jba06/family1/84690772804a4fe68e33a0f834348443 2023-11-11 11:55:47,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-11 11:55:47,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-11 11:55:47,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(1912): 147870233aed417eedc1252d62affc04/family1 is initiating minor compaction 2023-11-11 11:55:47,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@bdd6b8d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:55:47,043 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 147870233aed417eedc1252d62affc04/family1 in testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:47,043 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/2b10b15283ba439c8d5c5ad10e5546ed, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/67937881ffb5403ba479d121b85693d9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/3e49141005854b7eb8305b641a89cec6, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/325d1f4c41c740a4b8e5361200ec453c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/816eb17be789458ea55ffd44218fb23c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/d1c5921e4e7a4d9b9d946bcd245c4781, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/43ef03eed77e4740988197fad850ccaf, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/26b09e1fae7742a59f9c917f6d503330, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/9174acd67e0149899df795bda5e31585, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/ce655fb07c9c4cd385fc3c65e6770ad8_SeqId_44_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp, totalSize=49.7 K 2023-11-11 11:55:47,043 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 2b10b15283ba439c8d5c5ad10e5546ed, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-11 11:55:47,043 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 67937881ffb5403ba479d121b85693d9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-11 11:55:47,043 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 3e49141005854b7eb8305b641a89cec6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-11 11:55:47,043 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 325d1f4c41c740a4b8e5361200ec453c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-11 11:55:47,043 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 816eb17be789458ea55ffd44218fb23c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-11 11:55:47,043 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting d1c5921e4e7a4d9b9d946bcd245c4781, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-11 11:55:47,043 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 43ef03eed77e4740988197fad850ccaf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-11 11:55:47,043 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 26b09e1fae7742a59f9c917f6d503330, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-11 11:55:47,043 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 9174acd67e0149899df795bda5e31585, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-11 11:55:47,043 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting ce655fb07c9c4cd385fc3c65e6770ad8_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-11 11:55:47,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:55:47,045 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:47,046 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601011e5f061087e44a7897ddc6bfbb6527a2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601011e5f061087e44a7897ddc6bfbb6527a2 2023-11-11 11:55:47,047 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010387096698611445f99a6137204c37b4e8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010387096698611445f99a6137204c37b4e8 2023-11-11 11:55:47,047 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-11 11:55:47,047 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-11 11:55:47,047 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:55:47,047 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:55:47,074 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): 147870233aed417eedc1252d62affc04#family1#compaction#165 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:47,497 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123120b8fa385d6f4c6291d8fccc5a71887f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123120b8fa385d6f4c6291d8fccc5a71887f 2023-11-11 11:55:47,498 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:55:47,519 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e4e3d2a68a4046f3bb061add1e4c42d1 first=Optional[r1] last=Optional[r4] 2023-11-11 11:55:47,519 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e4e3d2a68a4046f3bb061add1e4c42d1}] 2023-11-11 11:55:47,521 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e4e3d2a68a4046f3bb061add1e4c42d1 for inclusion in 147870233aed417eedc1252d62affc04/family1 2023-11-11 11:55:47,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-11 11:55:47,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:55:47,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:47,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e4e3d2a68a4046f3bb061add1e4c42d1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ucnt8sajdfmhvpnblnut9vtv79h16b4f7uqgk98d7pi1a8p9k3ru70s8keblai49/family1/e4e3d2a68a4046f3bb061add1e4c42d1 2023-11-11 11:55:47,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ucnt8sajdfmhvpnblnut9vtv79h16b4f7uqgk98d7pi1a8p9k3ru70s8keblai49/family1/e4e3d2a68a4046f3bb061add1e4c42d1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/e031081715904675b8b573ce3488a997_SeqId_46_ 2023-11-11 11:55:47,529 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ucnt8sajdfmhvpnblnut9vtv79h16b4f7uqgk98d7pi1a8p9k3ru70s8keblai49/family1/e4e3d2a68a4046f3bb061add1e4c42d1 into 147870233aed417eedc1252d62affc04/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/e031081715904675b8b573ce3488a997_SeqId_46_ - updating store file list. 2023-11-11 11:55:47,532 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/e031081715904675b8b573ce3488a997_SeqId_46_ into 147870233aed417eedc1252d62affc04/family1 2023-11-11 11:55:47,532 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ucnt8sajdfmhvpnblnut9vtv79h16b4f7uqgk98d7pi1a8p9k3ru70s8keblai49/family1/e4e3d2a68a4046f3bb061add1e4c42d1 into 147870233aed417eedc1252d62affc04/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/e031081715904675b8b573ce3488a997_SeqId_46_) 2023-11-11 11:55:47,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ucnt8sajdfmhvpnblnut9vtv79h16b4f7uqgk98d7pi1a8p9k3ru70s8keblai49/family1/e4e3d2a68a4046f3bb061add1e4c42d1 2023-11-11 11:55:47,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:55:47,535 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:47,536 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120136f212286788476091df60aa7aa6a2f8 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120136f212286788476091df60aa7aa6a2f8 2023-11-11 11:55:47,537 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120588bd13a32a71412ca1633ea514503b1a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120588bd13a32a71412ca1633ea514503b1a 2023-11-11 11:55:47,538 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122826def0cf59864615bb90d1d9396c0721 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122826def0cf59864615bb90d1d9396c0721 2023-11-11 11:55:47,539 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123188ba7729d7c64427a621b34e135a21f6 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123188ba7729d7c64427a621b34e135a21f6 2023-11-11 11:55:47,539 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-11 11:55:47,539 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-11 11:55:47,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:55:47,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:55:47,889 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/669650c4f9a84344bec95747c12e5e00 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/669650c4f9a84344bec95747c12e5e00 2023-11-11 11:55:47,892 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 147870233aed417eedc1252d62affc04/family1 of 147870233aed417eedc1252d62affc04 into 669650c4f9a84344bec95747c12e5e00(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:55:47,893 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:47,893 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699703747042; duration=0sec 2023-11-11 11:55:47,893 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:55:47,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/2b10b15283ba439c8d5c5ad10e5546ed, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/67937881ffb5403ba479d121b85693d9, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/3e49141005854b7eb8305b641a89cec6, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/325d1f4c41c740a4b8e5361200ec453c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/816eb17be789458ea55ffd44218fb23c, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/d1c5921e4e7a4d9b9d946bcd245c4781, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/43ef03eed77e4740988197fad850ccaf, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/26b09e1fae7742a59f9c917f6d503330, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/9174acd67e0149899df795bda5e31585, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/ce655fb07c9c4cd385fc3c65e6770ad8_SeqId_44_] to archive 2023-11-11 11:55:47,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:47,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/2b10b15283ba439c8d5c5ad10e5546ed to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/2b10b15283ba439c8d5c5ad10e5546ed 2023-11-11 11:55:47,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/67937881ffb5403ba479d121b85693d9 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/67937881ffb5403ba479d121b85693d9 2023-11-11 11:55:47,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/3e49141005854b7eb8305b641a89cec6 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/3e49141005854b7eb8305b641a89cec6 2023-11-11 11:55:47,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/325d1f4c41c740a4b8e5361200ec453c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/325d1f4c41c740a4b8e5361200ec453c 2023-11-11 11:55:47,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/816eb17be789458ea55ffd44218fb23c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/816eb17be789458ea55ffd44218fb23c 2023-11-11 11:55:47,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/d1c5921e4e7a4d9b9d946bcd245c4781 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/d1c5921e4e7a4d9b9d946bcd245c4781 2023-11-11 11:55:47,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/43ef03eed77e4740988197fad850ccaf to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/43ef03eed77e4740988197fad850ccaf 2023-11-11 11:55:47,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/26b09e1fae7742a59f9c917f6d503330 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/26b09e1fae7742a59f9c917f6d503330 2023-11-11 11:55:47,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/9174acd67e0149899df795bda5e31585 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/9174acd67e0149899df795bda5e31585 2023-11-11 11:55:47,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/ce655fb07c9c4cd385fc3c65e6770ad8_SeqId_44_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/ce655fb07c9c4cd385fc3c65e6770ad8_SeqId_44_ 2023-11-11 11:55:48,379 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c0c8a7514e8d47ea907acf905394be81 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130c0c8a7514e8d47ea907acf905394be81 2023-11-11 11:55:48,381 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:55:48,402 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6b21fec34ea74490b1bad89cbe99b70e first=Optional[r00] last=Optional[r8] 2023-11-11 11:55:48,403 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6b21fec34ea74490b1bad89cbe99b70e}] 2023-11-11 11:55:48,404 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6b21fec34ea74490b1bad89cbe99b70e for inclusion in 147870233aed417eedc1252d62affc04/family1 2023-11-11 11:55:48,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-11 11:55:48,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last= 2023-11-11 11:55:48,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:48,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6b21fec34ea74490b1bad89cbe99b70e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ham288bkpa4q95p0gtivdnl5ba8hilb1j0htvqiufvmk9eoj6iejtvjvfcucd0ad/family1/6b21fec34ea74490b1bad89cbe99b70e 2023-11-11 11:55:48,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ham288bkpa4q95p0gtivdnl5ba8hilb1j0htvqiufvmk9eoj6iejtvjvfcucd0ad/family1/6b21fec34ea74490b1bad89cbe99b70e as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/606abf82bb2e4392a2913a798b3ec06c_SeqId_49_ 2023-11-11 11:55:48,410 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ham288bkpa4q95p0gtivdnl5ba8hilb1j0htvqiufvmk9eoj6iejtvjvfcucd0ad/family1/6b21fec34ea74490b1bad89cbe99b70e into 147870233aed417eedc1252d62affc04/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/606abf82bb2e4392a2913a798b3ec06c_SeqId_49_ - updating store file list. 2023-11-11 11:55:48,413 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/606abf82bb2e4392a2913a798b3ec06c_SeqId_49_ into 147870233aed417eedc1252d62affc04/family1 2023-11-11 11:55:48,414 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ham288bkpa4q95p0gtivdnl5ba8hilb1j0htvqiufvmk9eoj6iejtvjvfcucd0ad/family1/6b21fec34ea74490b1bad89cbe99b70e into 147870233aed417eedc1252d62affc04/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/606abf82bb2e4392a2913a798b3ec06c_SeqId_49_) 2023-11-11 11:55:48,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ham288bkpa4q95p0gtivdnl5ba8hilb1j0htvqiufvmk9eoj6iejtvjvfcucd0ad/family1/6b21fec34ea74490b1bad89cbe99b70e 2023-11-11 11:55:48,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-11 11:55:48,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-11 11:55:48,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(1912): 147870233aed417eedc1252d62affc04/family1 is initiating minor compaction (all files) 2023-11-11 11:55:48,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@790b7c54; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:55:48,416 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 147870233aed417eedc1252d62affc04/family1 in testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:55:48,416 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/b43bc05dfd4448088257368e57a52dd4, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/669650c4f9a84344bec95747c12e5e00, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/e031081715904675b8b573ce3488a997_SeqId_46_, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/606abf82bb2e4392a2913a798b3ec06c_SeqId_49_] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp, totalSize=344.3 K 2023-11-11 11:55:48,417 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting b43bc05dfd4448088257368e57a52dd4, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824916 2023-11-11 11:55:48,417 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 669650c4f9a84344bec95747c12e5e00, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224916 2023-11-11 11:55:48,417 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting e031081715904675b8b573ce3488a997_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965224916 2023-11-11 11:55:48,418 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:55:48,418 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] compactions.Compactor(207): Compacting 606abf82bb2e4392a2913a798b3ec06c_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014824916 2023-11-11 11:55:48,418 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:48,420 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120c635003ae023441aaa7793cbdb4d8a3b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120c635003ae023441aaa7793cbdb4d8a3b 2023-11-11 11:55:48,421 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128f4a93e48592b4330b3c9b1addaab7660 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128f4a93e48592b4330b3c9b1addaab7660 2023-11-11 11:55:48,421 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130479b87396ff2485891301ba6b64ee491 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130479b87396ff2485891301ba6b64ee491 2023-11-11 11:55:48,422 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-11 11:55:48,422 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-11 11:55:48,422 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:55:48,422 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:55:48,422 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-11 11:55:48,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-11 11:55:48,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:55:48,424 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-11 11:55:48,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2670 sec 2023-11-11 11:55:48,436 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] throttle.PressureAwareThroughputController(145): 147870233aed417eedc1252d62affc04#family1#compaction#166 average throughput is 17.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:48,625 INFO [Listener at localhost/39241] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=256 (was 249) - Thread LEAK? -, OpenFileDescriptor=677 (was 651) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=122 (was 126), ProcessCount=167 (was 170), AvailableMemoryMB=2430 (was 2432) 2023-11-11 11:55:48,636 INFO [Listener at localhost/39241] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=256, OpenFileDescriptor=677, MaxFileDescriptor=60000, SystemLoadAverage=122, ProcessCount=167, AvailableMemoryMB=2429 2023-11-11 11:55:48,656 DEBUG [Listener at localhost/39241] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-11 11:55:48,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA2e\x02w\xBC\xFAb\x86\xF6\xBAj\x9Db/\xDB\x04"\x10l\x05\x877.\x86\x92\xD9\xF4\xF2#\xCFc\x8F?g*\x101\xE5G7\xAC\xDF\xC8\xD0\xBB\x93\xB5\xFEa+\xDF\x972\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-11 11:55:48,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-11 11:55:48,711 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-11 11:55:48,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-11 11:55:48,712 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-11 11:55:48,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-11 11:55:48,714 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959 2023-11-11 11:55:48,714 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0 2023-11-11 11:55:48,714 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34 2023-11-11 11:55:48,714 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959 empty. 2023-11-11 11:55:48,715 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0 empty. 2023-11-11 11:55:48,715 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34 empty. 2023-11-11 11:55:48,715 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959 2023-11-11 11:55:48,715 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0 2023-11-11 11:55:48,715 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34 2023-11-11 11:55:48,715 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-11 11:55:48,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-11 11:55:48,857 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/.tmp/family1/02fc88af24e04d7a8912ea479942b8e8 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/02fc88af24e04d7a8912ea479942b8e8 2023-11-11 11:55:48,861 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 147870233aed417eedc1252d62affc04/family1 of 147870233aed417eedc1252d62affc04 into 02fc88af24e04d7a8912ea479942b8e8(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:55:48,861 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:55:48,861 INFO [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1699703748416; duration=0sec 2023-11-11 11:55:48,862 DEBUG [RS:0;jenkins-hbase4:41363-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-11 11:55:48,865 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/b43bc05dfd4448088257368e57a52dd4, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/669650c4f9a84344bec95747c12e5e00, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/e031081715904675b8b573ce3488a997_SeqId_46_, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/606abf82bb2e4392a2913a798b3ec06c_SeqId_49_] to archive 2023-11-11 11:55:48,865 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:55:48,867 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/b43bc05dfd4448088257368e57a52dd4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/b43bc05dfd4448088257368e57a52dd4 2023-11-11 11:55:48,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/669650c4f9a84344bec95747c12e5e00 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/669650c4f9a84344bec95747c12e5e00 2023-11-11 11:55:48,869 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/e031081715904675b8b573ce3488a997_SeqId_46_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/e031081715904675b8b573ce3488a997_SeqId_46_ 2023-11-11 11:55:48,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/606abf82bb2e4392a2913a798b3ec06c_SeqId_49_ to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/family1/606abf82bb2e4392a2913a798b3ec06c_SeqId_49_ 2023-11-11 11:55:49,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-11 11:55:49,123 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-11 11:55:49,125 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => b19d52a117473d66e99268a1c6bad959, NAME => 'testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA2e\x02w\xBC\xFAb\x86\xF6\xBAj\x9Db/\xDB\x04"\x10l\x05\x877.\x86\x92\xD9\xF4\xF2#\xCFc\x8F?g*\x101\xE5G7\xAC\xDF\xC8\xD0\xBB\x93\xB5\xFEa+\xDF\x972\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:55:49,125 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 1eb247784cfa55755a7f620156352c34, NAME => 'testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA2e\x02w\xBC\xFAb\x86\xF6\xBAj\x9Db/\xDB\x04"\x10l\x05\x877.\x86\x92\xD9\xF4\xF2#\xCFc\x8F?g*\x101\xE5G7\xAC\xDF\xC8\xD0\xBB\x93\xB5\xFEa+\xDF\x972\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:55:49,125 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 28c60b0dc97aae34619aed28ea7e61f0, NAME => 'testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA2e\x02w\xBC\xFAb\x86\xF6\xBAj\x9Db/\xDB\x04"\x10l\x05\x877.\x86\x92\xD9\xF4\xF2#\xCFc\x8F?g*\x101\xE5G7\xAC\xDF\xC8\xD0\xBB\x93\xB5\xFEa+\xDF\x972\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/.tmp 2023-11-11 11:55:49,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-11 11:55:49,538 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing b19d52a117473d66e99268a1c6bad959, disabling compactions & flushes 2023-11-11 11:55:49,539 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. after waiting 0 ms 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:49,539 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for b19d52a117473d66e99268a1c6bad959: 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 1eb247784cfa55755a7f620156352c34, disabling compactions & flushes 2023-11-11 11:55:49,539 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. after waiting 0 ms 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 28c60b0dc97aae34619aed28ea7e61f0, disabling compactions & flushes 2023-11-11 11:55:49,539 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:49,539 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 1eb247784cfa55755a7f620156352c34: 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. after waiting 0 ms 2023-11-11 11:55:49,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:49,540 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:49,540 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 28c60b0dc97aae34619aed28ea7e61f0: 2023-11-11 11:55:49,542 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-11 11:55:49,542 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703749542"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703749542"}]},"ts":"1699703749542"} 2023-11-11 11:55:49,543 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703749542"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703749542"}]},"ts":"1699703749542"} 2023-11-11 11:55:49,543 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699703749542"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699703749542"}]},"ts":"1699703749542"} 2023-11-11 11:55:49,544 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-11 11:55:49,545 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-11 11:55:49,545 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703749545"}]},"ts":"1699703749545"} 2023-11-11 11:55:49,546 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-11 11:55:49,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b19d52a117473d66e99268a1c6bad959, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=28c60b0dc97aae34619aed28ea7e61f0, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1eb247784cfa55755a7f620156352c34, ASSIGN}] 2023-11-11 11:55:49,552 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1eb247784cfa55755a7f620156352c34, ASSIGN 2023-11-11 11:55:49,552 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=28c60b0dc97aae34619aed28ea7e61f0, ASSIGN 2023-11-11 11:55:49,552 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b19d52a117473d66e99268a1c6bad959, ASSIGN 2023-11-11 11:55:49,552 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1eb247784cfa55755a7f620156352c34, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:55:49,552 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=28c60b0dc97aae34619aed28ea7e61f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:55:49,552 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b19d52a117473d66e99268a1c6bad959, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41363,1699703601801; forceNewPlan=false, retain=false 2023-11-11 11:55:49,704 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=28c60b0dc97aae34619aed28ea7e61f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:49,704 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=1eb247784cfa55755a7f620156352c34, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:49,704 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=b19d52a117473d66e99268a1c6bad959, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:49,704 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703749704"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703749704"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703749704"}]},"ts":"1699703749704"} 2023-11-11 11:55:49,704 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699703749704"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703749704"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703749704"}]},"ts":"1699703749704"} 2023-11-11 11:55:49,704 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703749704"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699703749704"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699703749704"}]},"ts":"1699703749704"} 2023-11-11 11:55:49,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 1eb247784cfa55755a7f620156352c34, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:55:49,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 28c60b0dc97aae34619aed28ea7e61f0, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:55:49,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure b19d52a117473d66e99268a1c6bad959, server=jenkins-hbase4.apache.org,41363,1699703601801}] 2023-11-11 11:55:49,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-11 11:55:49,857 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:49,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:49,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 28c60b0dc97aae34619aed28ea7e61f0, NAME => 'testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0.', STARTKEY => '1', ENDKEY => '2'} 2023-11-11 11:55:49,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 28c60b0dc97aae34619aed28ea7e61f0 2023-11-11 11:55:49,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:49,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 28c60b0dc97aae34619aed28ea7e61f0 2023-11-11 11:55:49,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 28c60b0dc97aae34619aed28ea7e61f0 2023-11-11 11:55:49,882 INFO [StoreOpener-28c60b0dc97aae34619aed28ea7e61f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 28c60b0dc97aae34619aed28ea7e61f0 2023-11-11 11:55:49,883 DEBUG [StoreOpener-28c60b0dc97aae34619aed28ea7e61f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1 2023-11-11 11:55:49,883 DEBUG [StoreOpener-28c60b0dc97aae34619aed28ea7e61f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1 2023-11-11 11:55:49,883 INFO [StoreOpener-28c60b0dc97aae34619aed28ea7e61f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28c60b0dc97aae34619aed28ea7e61f0 columnFamilyName family1 2023-11-11 11:55:49,884 INFO [StoreOpener-28c60b0dc97aae34619aed28ea7e61f0-1] regionserver.HStore(310): Store=28c60b0dc97aae34619aed28ea7e61f0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:49,884 INFO [StoreOpener-28c60b0dc97aae34619aed28ea7e61f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 28c60b0dc97aae34619aed28ea7e61f0 2023-11-11 11:55:49,885 DEBUG [StoreOpener-28c60b0dc97aae34619aed28ea7e61f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2 2023-11-11 11:55:49,886 DEBUG [StoreOpener-28c60b0dc97aae34619aed28ea7e61f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2 2023-11-11 11:55:49,886 INFO [StoreOpener-28c60b0dc97aae34619aed28ea7e61f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28c60b0dc97aae34619aed28ea7e61f0 columnFamilyName family2 2023-11-11 11:55:49,887 INFO [StoreOpener-28c60b0dc97aae34619aed28ea7e61f0-1] regionserver.HStore(310): Store=28c60b0dc97aae34619aed28ea7e61f0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:49,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0 2023-11-11 11:55:49,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0 2023-11-11 11:55:49,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:55:49,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 28c60b0dc97aae34619aed28ea7e61f0 2023-11-11 11:55:49,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:55:49,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 28c60b0dc97aae34619aed28ea7e61f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65610901, jitterRate=-0.022321388125419617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:55:49,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 28c60b0dc97aae34619aed28ea7e61f0: 2023-11-11 11:55:49,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0., pid=121, masterSystemTime=1699703749857 2023-11-11 11:55:49,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:49,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:49,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:49,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1eb247784cfa55755a7f620156352c34, NAME => 'testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34.', STARTKEY => '2', ENDKEY => ''} 2023-11-11 11:55:49,894 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=28c60b0dc97aae34619aed28ea7e61f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:49,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 1eb247784cfa55755a7f620156352c34 2023-11-11 11:55:49,894 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699703749894"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703749894"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703749894"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703749894"}]},"ts":"1699703749894"} 2023-11-11 11:55:49,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:49,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1eb247784cfa55755a7f620156352c34 2023-11-11 11:55:49,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1eb247784cfa55755a7f620156352c34 2023-11-11 11:55:49,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=118 2023-11-11 11:55:49,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 28c60b0dc97aae34619aed28ea7e61f0, server=jenkins-hbase4.apache.org,41363,1699703601801 in 189 msec 2023-11-11 11:55:49,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=28c60b0dc97aae34619aed28ea7e61f0, ASSIGN in 347 msec 2023-11-11 11:55:49,915 INFO [StoreOpener-1eb247784cfa55755a7f620156352c34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1eb247784cfa55755a7f620156352c34 2023-11-11 11:55:49,916 DEBUG [StoreOpener-1eb247784cfa55755a7f620156352c34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1 2023-11-11 11:55:49,916 DEBUG [StoreOpener-1eb247784cfa55755a7f620156352c34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1 2023-11-11 11:55:49,916 INFO [StoreOpener-1eb247784cfa55755a7f620156352c34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1eb247784cfa55755a7f620156352c34 columnFamilyName family1 2023-11-11 11:55:49,917 INFO [StoreOpener-1eb247784cfa55755a7f620156352c34-1] regionserver.HStore(310): Store=1eb247784cfa55755a7f620156352c34/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:49,917 INFO [StoreOpener-1eb247784cfa55755a7f620156352c34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1eb247784cfa55755a7f620156352c34 2023-11-11 11:55:49,918 DEBUG [StoreOpener-1eb247784cfa55755a7f620156352c34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2 2023-11-11 11:55:49,918 DEBUG [StoreOpener-1eb247784cfa55755a7f620156352c34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2 2023-11-11 11:55:49,919 INFO [StoreOpener-1eb247784cfa55755a7f620156352c34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1eb247784cfa55755a7f620156352c34 columnFamilyName family2 2023-11-11 11:55:49,919 INFO [StoreOpener-1eb247784cfa55755a7f620156352c34-1] regionserver.HStore(310): Store=1eb247784cfa55755a7f620156352c34/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:49,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34 2023-11-11 11:55:49,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34 2023-11-11 11:55:49,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:55:49,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1eb247784cfa55755a7f620156352c34 2023-11-11 11:55:49,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:55:49,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1eb247784cfa55755a7f620156352c34; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58954375, jitterRate=-0.12151135504245758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:55:49,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1eb247784cfa55755a7f620156352c34: 2023-11-11 11:55:49,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34., pid=120, masterSystemTime=1699703749857 2023-11-11 11:55:49,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:49,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:49,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:49,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b19d52a117473d66e99268a1c6bad959, NAME => 'testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959.', STARTKEY => '', ENDKEY => '1'} 2023-11-11 11:55:49,926 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=1eb247784cfa55755a7f620156352c34, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:49,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin b19d52a117473d66e99268a1c6bad959 2023-11-11 11:55:49,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-11 11:55:49,926 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703749926"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703749926"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703749926"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703749926"}]},"ts":"1699703749926"} 2023-11-11 11:55:49,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b19d52a117473d66e99268a1c6bad959 2023-11-11 11:55:49,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b19d52a117473d66e99268a1c6bad959 2023-11-11 11:55:49,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=119 2023-11-11 11:55:49,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 1eb247784cfa55755a7f620156352c34, server=jenkins-hbase4.apache.org,41363,1699703601801 in 221 msec 2023-11-11 11:55:49,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1eb247784cfa55755a7f620156352c34, ASSIGN in 378 msec 2023-11-11 11:55:49,946 INFO [StoreOpener-b19d52a117473d66e99268a1c6bad959-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b19d52a117473d66e99268a1c6bad959 2023-11-11 11:55:49,947 DEBUG [StoreOpener-b19d52a117473d66e99268a1c6bad959-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1 2023-11-11 11:55:49,948 DEBUG [StoreOpener-b19d52a117473d66e99268a1c6bad959-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1 2023-11-11 11:55:49,948 INFO [StoreOpener-b19d52a117473d66e99268a1c6bad959-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b19d52a117473d66e99268a1c6bad959 columnFamilyName family1 2023-11-11 11:55:49,948 INFO [StoreOpener-b19d52a117473d66e99268a1c6bad959-1] regionserver.HStore(310): Store=b19d52a117473d66e99268a1c6bad959/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:49,949 INFO [StoreOpener-b19d52a117473d66e99268a1c6bad959-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b19d52a117473d66e99268a1c6bad959 2023-11-11 11:55:49,950 DEBUG [StoreOpener-b19d52a117473d66e99268a1c6bad959-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2 2023-11-11 11:55:49,950 DEBUG [StoreOpener-b19d52a117473d66e99268a1c6bad959-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2 2023-11-11 11:55:49,950 INFO [StoreOpener-b19d52a117473d66e99268a1c6bad959-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b19d52a117473d66e99268a1c6bad959 columnFamilyName family2 2023-11-11 11:55:49,950 INFO [StoreOpener-b19d52a117473d66e99268a1c6bad959-1] regionserver.HStore(310): Store=b19d52a117473d66e99268a1c6bad959/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-11 11:55:49,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959 2023-11-11 11:55:49,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959 2023-11-11 11:55:49,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-11 11:55:49,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b19d52a117473d66e99268a1c6bad959 2023-11-11 11:55:49,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-11 11:55:49,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b19d52a117473d66e99268a1c6bad959; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65062920, jitterRate=-0.03048694133758545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-11 11:55:49,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b19d52a117473d66e99268a1c6bad959: 2023-11-11 11:55:49,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959., pid=122, masterSystemTime=1699703749857 2023-11-11 11:55:49,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:49,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:49,957 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=b19d52a117473d66e99268a1c6bad959, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:49,957 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699703749957"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699703749957"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699703749957"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699703749957"}]},"ts":"1699703749957"} 2023-11-11 11:55:49,959 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=117 2023-11-11 11:55:49,959 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure b19d52a117473d66e99268a1c6bad959, server=jenkins-hbase4.apache.org,41363,1699703601801 in 251 msec 2023-11-11 11:55:49,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-11-11 11:55:49,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b19d52a117473d66e99268a1c6bad959, ASSIGN in 409 msec 2023-11-11 11:55:49,960 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-11 11:55:49,960 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699703749960"}]},"ts":"1699703749960"} 2023-11-11 11:55:49,961 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-11 11:55:49,963 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-11 11:55:49,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2540 sec 2023-11-11 11:55:50,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-11 11:55:50,818 INFO [Listener at localhost/39241] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-11 11:55:50,824 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:50,825 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:50,825 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:50,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:50,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-11 11:55:50,828 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-11 11:55:50,828 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:50,828 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-11 11:55:50,828 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-11 11:55:50,829 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:50,829 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:50,830 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:50,830 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:50,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:50,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:50,830 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:50,830 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:50,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:50,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:50,831 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-11 11:55:50,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-11 11:55:50,831 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-11 11:55:50,831 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:50,831 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-11 11:55:50,832 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:50,832 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:50,832 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:55:50,832 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:50,832 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:50,832 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. started... 2023-11-11 11:55:50,832 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. started... 2023-11-11 11:55:50,832 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. started... 2023-11-11 11:55:50,833 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 28c60b0dc97aae34619aed28ea7e61f0 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 11:55:50,833 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1eb247784cfa55755a7f620156352c34 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 11:55:50,833 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b19d52a117473d66e99268a1c6bad959 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-11 11:55:51,276 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111135b89eec27dc4442abf96c4f560a2545 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111135b89eec27dc4442abf96c4f560a2545 2023-11-11 11:55:51,284 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111686011b970e043848debf0f72c834573 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111686011b970e043848debf0f72c834573 2023-11-11 11:55:51,291 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family1/30fbe3d778594fea925d5ed59461f622 2023-11-11 11:55:51,291 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111d5e16cad7ff44ca0ab449c0fd235a2f4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111d5e16cad7ff44ca0ab449c0fd235a2f4 2023-11-11 11:55:51,299 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family1/e37c2a71301c46699b5bf48834c5066b 2023-11-11 11:55:51,336 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111087cda74b8f045b399ecee339af64116 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231111087cda74b8f045b399ecee339af64116 2023-11-11 11:55:51,344 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111b0710a3226e4458a82b35e6c126288d3 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231111b0710a3226e4458a82b35e6c126288d3 2023-11-11 11:55:51,349 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family2/45c75266c870417f872f3323211bd7c2 2023-11-11 11:55:51,350 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family2/eebf81b69b454912a1bfdca18c1c8d10 2023-11-11 11:55:51,353 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family1/e37c2a71301c46699b5bf48834c5066b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/e37c2a71301c46699b5bf48834c5066b 2023-11-11 11:55:51,354 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family1/30fbe3d778594fea925d5ed59461f622 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/30fbe3d778594fea925d5ed59461f622 2023-11-11 11:55:51,376 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/30fbe3d778594fea925d5ed59461f622, entries=4, sequenceid=5, filesize=5.5 K 2023-11-11 11:55:51,377 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/e37c2a71301c46699b5bf48834c5066b, entries=4, sequenceid=5, filesize=5.5 K 2023-11-11 11:55:51,377 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family2/eebf81b69b454912a1bfdca18c1c8d10 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/eebf81b69b454912a1bfdca18c1c8d10 2023-11-11 11:55:51,377 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family2/45c75266c870417f872f3323211bd7c2 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/45c75266c870417f872f3323211bd7c2 2023-11-11 11:55:51,381 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/eebf81b69b454912a1bfdca18c1c8d10, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 11:55:51,381 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/45c75266c870417f872f3323211bd7c2, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 11:55:51,381 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 28c60b0dc97aae34619aed28ea7e61f0 in 548ms, sequenceid=5, compaction requested=false 2023-11-11 11:55:51,381 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1eb247784cfa55755a7f620156352c34 in 548ms, sequenceid=5, compaction requested=false 2023-11-11 11:55:51,381 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-11 11:55:51,381 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-11 11:55:51,383 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 28c60b0dc97aae34619aed28ea7e61f0: 2023-11-11 11:55:51,383 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1eb247784cfa55755a7f620156352c34: 2023-11-11 11:55:51,383 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:51,383 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:51,383 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:55:51,383 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:55:51,707 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family1/80b796940cee47a696de68fafda58ce3 2023-11-11 11:55:52,139 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311116ea00cb1ac5248b8ac6379e172a78831 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311116ea00cb1ac5248b8ac6379e172a78831 2023-11-11 11:55:52,544 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family2/f05b57e0781842129406541da1e2aefe 2023-11-11 11:55:52,548 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family1/80b796940cee47a696de68fafda58ce3 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/80b796940cee47a696de68fafda58ce3 2023-11-11 11:55:52,574 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/80b796940cee47a696de68fafda58ce3, entries=4, sequenceid=5, filesize=5.5 K 2023-11-11 11:55:52,575 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family2/f05b57e0781842129406541da1e2aefe as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/f05b57e0781842129406541da1e2aefe 2023-11-11 11:55:52,578 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/f05b57e0781842129406541da1e2aefe, entries=2, sequenceid=5, filesize=5.1 K 2023-11-11 11:55:52,579 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b19d52a117473d66e99268a1c6bad959 in 1746ms, sequenceid=5, compaction requested=false 2023-11-11 11:55:52,579 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b19d52a117473d66e99268a1c6bad959: 2023-11-11 11:55:52,579 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:52,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:55:52,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:55:52,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-11 11:55:52,579 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-11 11:55:52,582 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:52,582 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:52,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:52,582 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:52,582 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:52,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:52,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:52,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:52,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:52,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-11 11:55:52,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20fb4aac[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:52,583 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-11 11:55:52,584 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:52,585 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:52,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:52,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:52,585 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-11 11:55:52,585 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-11 11:55:52,585 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,585 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:52,585 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:52,586 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-11 11:55:52,586 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,586 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:52,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:52,586 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-11 11:55:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:52,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:52,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:52,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:52,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-11 11:55:52,589 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-11 11:55:52,589 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:52,589 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:52,589 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-11 11:55:52,589 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:52,595 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:52,595 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:52,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:52,595 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:52,595 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:52,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:52,596 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,598 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,598 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:52,598 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:52,598 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:52,598 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:52,599 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,599 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:52,599 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:52,599 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:52,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:52,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:52,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-11 11:55:52,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-11 11:55:52,598 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:52,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:52,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:52,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:52,599 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:52,599 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:52,699 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:52,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:52,701 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:52,702 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:52,702 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:52,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:52,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:52,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-11 11:55:52,706 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-11 11:55:52,706 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:52,706 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-11 11:55:52,706 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-11 11:55:52,707 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:52,707 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:52,708 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,708 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:52,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:52,708 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:52,708 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:52,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:52,709 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-11 11:55:52,709 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-11 11:55:52,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-11 11:55:52,709 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-11 11:55:52,709 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:52,709 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-11 11:55:52,710 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:52,710 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. started... 2023-11-11 11:55:52,710 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:52,710 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. started... 2023-11-11 11:55:52,710 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:55:52,710 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:52,710 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 28c60b0dc97aae34619aed28ea7e61f0 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 11:55:52,710 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1eb247784cfa55755a7f620156352c34 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 11:55:52,710 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:52,710 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. started... 2023-11-11 11:55:52,710 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b19d52a117473d66e99268a1c6bad959 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-11 11:55:52,754 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111f751d2fe1cc546deb833b71c05dc2548 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111f751d2fe1cc546deb833b71c05dc2548 2023-11-11 11:55:53,168 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family1/f071dfbb41f5432085a1b6fd0fa83865 2023-11-11 11:55:53,175 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111aef7de56be334ff79933794007ea727e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111aef7de56be334ff79933794007ea727e 2023-11-11 11:55:53,175 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311115155105daa8a465c9404b908bac679c2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311115155105daa8a465c9404b908bac679c2 2023-11-11 11:55:53,196 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family1/b5956d6cf724464eba657ade4687edbb 2023-11-11 11:55:53,201 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family1/2ded254d8b8f478a8aac8285c41703f7 2023-11-11 11:55:53,219 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111186ee74a7e9f94ede855afff529afb1a7 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023111186ee74a7e9f94ede855afff529afb1a7 2023-11-11 11:55:53,624 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family2/c371378ededc49b7a5896990cfb2328e 2023-11-11 11:55:53,628 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family1/f071dfbb41f5432085a1b6fd0fa83865 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/f071dfbb41f5432085a1b6fd0fa83865 2023-11-11 11:55:53,641 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111f15b7299cef844e4be741e4db1077487 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231111f15b7299cef844e4be741e4db1077487 2023-11-11 11:55:53,642 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311119ccea34f49b14ab1b4ca64f83c4a0df4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311119ccea34f49b14ab1b4ca64f83c4a0df4 2023-11-11 11:55:53,650 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family2/a313d0b01b7d47fa973fff03f3f21fd0 2023-11-11 11:55:53,653 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family1/b5956d6cf724464eba657ade4687edbb as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/b5956d6cf724464eba657ade4687edbb 2023-11-11 11:55:53,655 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/f071dfbb41f5432085a1b6fd0fa83865, entries=4, sequenceid=9, filesize=5.5 K 2023-11-11 11:55:53,656 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family2/c371378ededc49b7a5896990cfb2328e as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/c371378ededc49b7a5896990cfb2328e 2023-11-11 11:55:53,659 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/c371378ededc49b7a5896990cfb2328e, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 11:55:53,659 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1eb247784cfa55755a7f620156352c34 in 949ms, sequenceid=9, compaction requested=false 2023-11-11 11:55:53,660 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1eb247784cfa55755a7f620156352c34: 2023-11-11 11:55:53,660 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:53,660 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:55:53,689 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/b5956d6cf724464eba657ade4687edbb, entries=4, sequenceid=9, filesize=5.5 K 2023-11-11 11:55:53,690 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family2/a313d0b01b7d47fa973fff03f3f21fd0 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/a313d0b01b7d47fa973fff03f3f21fd0 2023-11-11 11:55:53,694 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/a313d0b01b7d47fa973fff03f3f21fd0, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 11:55:53,695 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 28c60b0dc97aae34619aed28ea7e61f0 in 985ms, sequenceid=9, compaction requested=false 2023-11-11 11:55:53,695 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 28c60b0dc97aae34619aed28ea7e61f0: 2023-11-11 11:55:53,695 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:53,696 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:55:54,050 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family2/3e71947a813e4e4aa1e9ebe4259686b1 2023-11-11 11:55:54,054 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family1/2ded254d8b8f478a8aac8285c41703f7 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/2ded254d8b8f478a8aac8285c41703f7 2023-11-11 11:55:54,085 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/2ded254d8b8f478a8aac8285c41703f7, entries=4, sequenceid=9, filesize=5.5 K 2023-11-11 11:55:54,086 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family2/3e71947a813e4e4aa1e9ebe4259686b1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/3e71947a813e4e4aa1e9ebe4259686b1 2023-11-11 11:55:54,089 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/3e71947a813e4e4aa1e9ebe4259686b1, entries=2, sequenceid=9, filesize=5.1 K 2023-11-11 11:55:54,090 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b19d52a117473d66e99268a1c6bad959 in 1380ms, sequenceid=9, compaction requested=false 2023-11-11 11:55:54,090 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b19d52a117473d66e99268a1c6bad959: 2023-11-11 11:55:54,090 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:55:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:55:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,091 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-11 11:55:54,091 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-11 11:55:54,092 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,092 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:54,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:54,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:54,092 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:54,093 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:54,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:54,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:54,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:54,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:54,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-11 11:55:54,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26f39482[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:54,094 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-11 11:55:54,094 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:54,096 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:54,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:54,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:54,096 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-11 11:55:54,096 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-11 11:55:54,096 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:54,096 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,096 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:54,098 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-11 11:55:54,098 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,098 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:54,098 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-11 11:55:54,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:54,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:54,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:54,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:54,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-11 11:55:54,100 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-11 11:55:54,100 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:54,100 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:54,100 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-11 11:55:54,100 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:54,101 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:54,101 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:54,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:54,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:54,101 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:54,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:54,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:54,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:54,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:54,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:54,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:54,102 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:54,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,103 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,105 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,105 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:54,106 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:54,106 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:54,106 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:54,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-11 11:55:54,106 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:54,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:54,106 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:54,106 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:54,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:54,106 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:54,106 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:54,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:54,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:54,106 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:54,106 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:54,206 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:54,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:54,208 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:54,209 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:54,209 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:54,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:54,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:54,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-11 11:55:54,213 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-11 11:55:54,213 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:54,213 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-11 11:55:54,213 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-11 11:55:54,214 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:54,214 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:54,216 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,216 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:54,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:54,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:54,216 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:54,216 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:54,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:54,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:54,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:54,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:54,217 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-11 11:55:54,218 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-11 11:55:54,218 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-11 11:55:54,218 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-11 11:55:54,218 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:54,218 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-11 11:55:54,218 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:54,218 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:55:54,218 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:54,218 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:54,218 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. started... 2023-11-11 11:55:54,218 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:54,218 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. started... 2023-11-11 11:55:54,218 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. started... 2023-11-11 11:55:54,218 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1eb247784cfa55755a7f620156352c34 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 11:55:54,218 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b19d52a117473d66e99268a1c6bad959 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 11:55:54,218 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 28c60b0dc97aae34619aed28ea7e61f0 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-11 11:55:54,269 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311113d027b9564fb4b69af1947c403eb9184 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311113d027b9564fb4b69af1947c403eb9184 2023-11-11 11:55:54,269 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311118f64d318211c43df848b24762a8788be to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311118f64d318211c43df848b24762a8788be 2023-11-11 11:55:54,664 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111ef9fdfa64aa84b36b493c8f8b83dc486 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111ef9fdfa64aa84b36b493c8f8b83dc486 2023-11-11 11:55:54,684 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family1/44c501da2f4b40bcb53646faaf88f0f5 2023-11-11 11:55:54,684 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family1/f2af5478176a4bc2b4dc9554e348403a 2023-11-11 11:55:54,724 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111dbd1b421ab3e46319b1d2cd84a016a2e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231111dbd1b421ab3e46319b1d2cd84a016a2e 2023-11-11 11:55:54,729 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family2/3fb9175264594b2b8aa67eb1041c9ffd 2023-11-11 11:55:54,732 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family1/44c501da2f4b40bcb53646faaf88f0f5 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/44c501da2f4b40bcb53646faaf88f0f5 2023-11-11 11:55:54,769 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/44c501da2f4b40bcb53646faaf88f0f5, entries=4, sequenceid=13, filesize=5.5 K 2023-11-11 11:55:54,769 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family2/3fb9175264594b2b8aa67eb1041c9ffd as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/3fb9175264594b2b8aa67eb1041c9ffd 2023-11-11 11:55:54,772 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/3fb9175264594b2b8aa67eb1041c9ffd, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 11:55:54,773 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1eb247784cfa55755a7f620156352c34 in 555ms, sequenceid=13, compaction requested=true 2023-11-11 11:55:54,773 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1eb247784cfa55755a7f620156352c34: 2023-11-11 11:55:54,773 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:54,773 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:55:54,901 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:55:54,901 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7468ea17 to 127.0.0.1:59344 2023-11-11 11:55:54,901 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:55:54,901 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:55:54,901 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45ab772c to 127.0.0.1:59344 2023-11-11 11:55:54,901 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:55:55,078 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family1/23b454b769c047d488f0fee16605cbce 2023-11-11 11:55:55,116 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111169978bb3f852424bb0c892f5c5c67aa5 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023111169978bb3f852424bb0c892f5c5c67aa5 2023-11-11 11:55:55,122 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111aa80997365f14c3ba8d0617eeb1fe99d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231111aa80997365f14c3ba8d0617eeb1fe99d 2023-11-11 11:55:55,125 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family2/efeba7938eca460a90da937536e0140d 2023-11-11 11:55:55,129 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family1/23b454b769c047d488f0fee16605cbce as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/23b454b769c047d488f0fee16605cbce 2023-11-11 11:55:55,151 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/23b454b769c047d488f0fee16605cbce, entries=4, sequenceid=13, filesize=5.5 K 2023-11-11 11:55:55,152 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family2/efeba7938eca460a90da937536e0140d as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/efeba7938eca460a90da937536e0140d 2023-11-11 11:55:55,155 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/efeba7938eca460a90da937536e0140d, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 11:55:55,156 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b19d52a117473d66e99268a1c6bad959 in 938ms, sequenceid=13, compaction requested=true 2023-11-11 11:55:55,156 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b19d52a117473d66e99268a1c6bad959: 2023-11-11 11:55:55,156 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:55,156 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:55:55,417 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-11 11:55:55,526 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family2/933324546c16470d9a1b4f8e9a69c5ba 2023-11-11 11:55:55,530 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family1/f2af5478176a4bc2b4dc9554e348403a as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/f2af5478176a4bc2b4dc9554e348403a 2023-11-11 11:55:55,552 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/f2af5478176a4bc2b4dc9554e348403a, entries=4, sequenceid=13, filesize=5.5 K 2023-11-11 11:55:55,553 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family2/933324546c16470d9a1b4f8e9a69c5ba as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/933324546c16470d9a1b4f8e9a69c5ba 2023-11-11 11:55:55,556 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/933324546c16470d9a1b4f8e9a69c5ba, entries=2, sequenceid=13, filesize=5.1 K 2023-11-11 11:55:55,557 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 28c60b0dc97aae34619aed28ea7e61f0 in 1339ms, sequenceid=13, compaction requested=true 2023-11-11 11:55:55,557 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 28c60b0dc97aae34619aed28ea7e61f0: 2023-11-11 11:55:55,557 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:55,557 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:55:55,557 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:55:55,557 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,557 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-11 11:55:55,557 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-11 11:55:55,559 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:55,559 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:55,559 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:55,559 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:55,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-11 11:55:55,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a36972e[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:55,561 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-11 11:55:55,561 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:55,563 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:55,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:55,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:55,563 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-11 11:55:55,563 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,563 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:55,563 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-11 11:55:55,563 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:55,564 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,564 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-11 11:55:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,564 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:55,564 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-11 11:55:55,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:55,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:55,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:55,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:55,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-11 11:55:55,566 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-11 11:55:55,567 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:55,567 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:55,567 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-11 11:55:55,567 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:55,568 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:55,568 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:55,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:55,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:55,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:55,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:55,568 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:55,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:55,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:55,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:55,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:55,569 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:55,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:55,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:55,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:55,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,570 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:55,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:55,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,573 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:55,573 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,573 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:55,573 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:55,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:55,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-11 11:55:55,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:55,573 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:55,573 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:55,573 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,573 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:55,573 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:55,573 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:55,573 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:55,573 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:55,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:55,673 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:55,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:55,675 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:55,675 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:55,676 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. with WAL disabled. Data may be lost in the event of a crash. 2023-11-11 11:55:55,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:55,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:55,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-11 11:55:55,679 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-11 11:55:55,679 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:55,679 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-11 11:55:55,679 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-11 11:55:55,680 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:55,680 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:55,682 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:55,682 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:55,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:55,682 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:55,682 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:55,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:55,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:55,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:55,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:55,683 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-11 11:55:55,683 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-11 11:55:55,683 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-11 11:55:55,683 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-11 11:55:55,683 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:55,684 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-11 11:55:55,689 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:55,689 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:55,689 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. started... 2023-11-11 11:55:55,689 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. started... 2023-11-11 11:55:55,689 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:55,689 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:55:55,690 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:55,690 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 28c60b0dc97aae34619aed28ea7e61f0 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 11:55:55,690 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. started... 2023-11-11 11:55:55,690 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1eb247784cfa55755a7f620156352c34 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 11:55:55,690 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b19d52a117473d66e99268a1c6bad959 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-11 11:55:55,731 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111c15c0c3bbe0e4a25b7ee9548e7c1c4cb to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111c15c0c3bbe0e4a25b7ee9548e7c1c4cb 2023-11-11 11:55:55,746 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111196aea548cf654a71ad9e6dee28fe9b23 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111196aea548cf654a71ad9e6dee28fe9b23 2023-11-11 11:55:55,746 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111139ab0c1b0eef4b81b3fb62e8ce602153 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111139ab0c1b0eef4b81b3fb62e8ce602153 2023-11-11 11:55:55,750 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family1/7f18d9fd3dd148fe8cad5cf6cc0c395e 2023-11-11 11:55:55,789 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111b88c3d26873047f79546f2f871ae6c2c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231111b88c3d26873047f79546f2f871ae6c2c 2023-11-11 11:55:55,796 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family2/4ddbc17ca15346f9bfebb2da19023149 2023-11-11 11:55:55,799 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family1/7f18d9fd3dd148fe8cad5cf6cc0c395e as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/7f18d9fd3dd148fe8cad5cf6cc0c395e 2023-11-11 11:55:55,822 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/7f18d9fd3dd148fe8cad5cf6cc0c395e, entries=4, sequenceid=17, filesize=5.5 K 2023-11-11 11:55:55,823 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family2/4ddbc17ca15346f9bfebb2da19023149 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/4ddbc17ca15346f9bfebb2da19023149 2023-11-11 11:55:55,825 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/4ddbc17ca15346f9bfebb2da19023149, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 11:55:55,826 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b19d52a117473d66e99268a1c6bad959 in 136ms, sequenceid=17, compaction requested=true 2023-11-11 11:55:55,826 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b19d52a117473d66e99268a1c6bad959: 2023-11-11 11:55:55,826 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:55,826 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:55:56,174 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family1/d712291b08cd4552a8933b3550947376 2023-11-11 11:55:56,174 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family1/cb109bc42f0f45cfa5fce47018b436f5 2023-11-11 11:55:56,610 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231111e953865eeb474db08e64e6ed7cd53d12 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231111e953865eeb474db08e64e6ed7cd53d12 2023-11-11 11:55:56,611 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311116144b19c0b7f4008b13cc4b1c6e4dc5c to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311116144b19c0b7f4008b13cc4b1c6e4dc5c 2023-11-11 11:55:57,015 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family2/99f669c9619e404c81a1770fddcdd84f 2023-11-11 11:55:57,015 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family2/1b728decab704b0388a01c5ffa546df3 2023-11-11 11:55:57,019 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family1/cb109bc42f0f45cfa5fce47018b436f5 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/cb109bc42f0f45cfa5fce47018b436f5 2023-11-11 11:55:57,019 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family1/d712291b08cd4552a8933b3550947376 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/d712291b08cd4552a8933b3550947376 2023-11-11 11:55:57,042 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/cb109bc42f0f45cfa5fce47018b436f5, entries=4, sequenceid=17, filesize=5.5 K 2023-11-11 11:55:57,042 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family2/99f669c9619e404c81a1770fddcdd84f as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/99f669c9619e404c81a1770fddcdd84f 2023-11-11 11:55:57,046 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/99f669c9619e404c81a1770fddcdd84f, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 11:55:57,047 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 28c60b0dc97aae34619aed28ea7e61f0 in 1358ms, sequenceid=17, compaction requested=true 2023-11-11 11:55:57,047 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 28c60b0dc97aae34619aed28ea7e61f0: 2023-11-11 11:55:57,047 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:57,047 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:55:57,052 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/d712291b08cd4552a8933b3550947376, entries=4, sequenceid=17, filesize=5.5 K 2023-11-11 11:55:57,052 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family2/1b728decab704b0388a01c5ffa546df3 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/1b728decab704b0388a01c5ffa546df3 2023-11-11 11:55:57,056 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/1b728decab704b0388a01c5ffa546df3, entries=2, sequenceid=17, filesize=5.1 K 2023-11-11 11:55:57,057 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1eb247784cfa55755a7f620156352c34 in 1368ms, sequenceid=17, compaction requested=true 2023-11-11 11:55:57,057 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1eb247784cfa55755a7f620156352c34: 2023-11-11 11:55:57,057 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:55:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:55:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,058 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-11 11:55:57,058 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-11 11:55:57,060 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,060 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:57,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:57,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:57,061 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:57,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:57,061 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:57,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:57,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:57,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:57,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-11 11:55:57,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f6027d6[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:57,062 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-11 11:55:57,062 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:57,067 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:57,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:57,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:57,068 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-11 11:55:57,068 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-11 11:55:57,068 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:57,068 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,068 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:57,069 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-11 11:55:57,069 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,069 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:57,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:57,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:57,069 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-11 11:55:57,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:57,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:57,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:57,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:57,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:57,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:57,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-11 11:55:57,072 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-11 11:55:57,072 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:57,072 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:57,072 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-11 11:55:57,072 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:57,073 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:57,073 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:57,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:57,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:57,073 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:57,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:57,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:57,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:57,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:57,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:57,074 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:57,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:57,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:57,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:57,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:57,075 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:57,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:57,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,077 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,077 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:57,077 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:57,077 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:57,077 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:57,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-11 11:55:57,077 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:57,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-11 11:55:57,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:57,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:57,078 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:57,078 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:57,078 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:57,078 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:57,078 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:57,078 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:57,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:57,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:57,178 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:57,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:57,188 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:57,196 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:57,204 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:55:57,205 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:55:57,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-11 11:55:57,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-11 11:55:57,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-11 11:55:57,305 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-11 11:55:57,305 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:57,305 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-11 11:55:57,305 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-11 11:55:57,306 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:57,306 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:57,308 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:57,308 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:57,309 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:57,309 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-11 11:55:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:57,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-11 11:55:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:57,310 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-11 11:55:57,310 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-11 11:55:57,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-11 11:55:57,310 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-11 11:55:57,310 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-11 11:55:57,310 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-11 11:55:57,310 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:57,310 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. started... 2023-11-11 11:55:57,310 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-11 11:55:57,310 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:57,310 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-11 11:55:57,310 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:57,310 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1eb247784cfa55755a7f620156352c34 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 11:55:57,310 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. started... 2023-11-11 11:55:57,310 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. started... 2023-11-11 11:55:57,311 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b19d52a117473d66e99268a1c6bad959 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 11:55:57,311 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 28c60b0dc97aae34619aed28ea7e61f0 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-11 11:55:57,744 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family1/f16fdd1a252c491da524bfb126961c04 2023-11-11 11:55:57,750 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family1/9131ccd095f34a39ba9168524f4ad942 2023-11-11 11:55:57,766 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f16fdd1a252c491da524bfb126961c04 2023-11-11 11:55:57,772 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9131ccd095f34a39ba9168524f4ad942 2023-11-11 11:55:57,790 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family2/e2db23cce1d149899989a2198491c209 2023-11-11 11:55:57,792 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2db23cce1d149899989a2198491c209 2023-11-11 11:55:57,793 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family1/9131ccd095f34a39ba9168524f4ad942 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/9131ccd095f34a39ba9168524f4ad942 2023-11-11 11:55:57,815 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9131ccd095f34a39ba9168524f4ad942 2023-11-11 11:55:57,816 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/9131ccd095f34a39ba9168524f4ad942, entries=3, sequenceid=23, filesize=5.2 K 2023-11-11 11:55:57,816 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family2/e2db23cce1d149899989a2198491c209 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/e2db23cce1d149899989a2198491c209 2023-11-11 11:55:57,819 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2db23cce1d149899989a2198491c209 2023-11-11 11:55:57,819 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/e2db23cce1d149899989a2198491c209, entries=1, sequenceid=23, filesize=5.0 K 2023-11-11 11:55:57,820 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1eb247784cfa55755a7f620156352c34 in 510ms, sequenceid=23, compaction requested=true 2023-11-11 11:55:57,820 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1eb247784cfa55755a7f620156352c34: 2023-11-11 11:55:57,820 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:57,820 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-11 11:55:58,143 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family1/8915621b836547c6a15d9e3ae53ba74d 2023-11-11 11:55:58,166 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8915621b836547c6a15d9e3ae53ba74d 2023-11-11 11:55:58,181 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family2/1fc0aeff198b49028c385b5b1c28037b 2023-11-11 11:55:58,184 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fc0aeff198b49028c385b5b1c28037b 2023-11-11 11:55:58,184 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family1/f16fdd1a252c491da524bfb126961c04 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/f16fdd1a252c491da524bfb126961c04 2023-11-11 11:55:58,209 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f16fdd1a252c491da524bfb126961c04 2023-11-11 11:55:58,209 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/f16fdd1a252c491da524bfb126961c04, entries=3, sequenceid=23, filesize=5.2 K 2023-11-11 11:55:58,210 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family2/1fc0aeff198b49028c385b5b1c28037b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/1fc0aeff198b49028c385b5b1c28037b 2023-11-11 11:55:58,213 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fc0aeff198b49028c385b5b1c28037b 2023-11-11 11:55:58,213 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/1fc0aeff198b49028c385b5b1c28037b, entries=1, sequenceid=23, filesize=5.0 K 2023-11-11 11:55:58,213 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 28c60b0dc97aae34619aed28ea7e61f0 in 902ms, sequenceid=23, compaction requested=true 2023-11-11 11:55:58,214 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 28c60b0dc97aae34619aed28ea7e61f0: 2023-11-11 11:55:58,214 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:55:58,214 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-11 11:55:58,977 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family2/b4f23dc8eb9f40ae8052832deabf36ca 2023-11-11 11:55:58,980 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4f23dc8eb9f40ae8052832deabf36ca 2023-11-11 11:55:58,981 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family1/8915621b836547c6a15d9e3ae53ba74d as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/8915621b836547c6a15d9e3ae53ba74d 2023-11-11 11:55:59,004 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8915621b836547c6a15d9e3ae53ba74d 2023-11-11 11:55:59,004 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/8915621b836547c6a15d9e3ae53ba74d, entries=3, sequenceid=23, filesize=5.2 K 2023-11-11 11:55:59,004 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family2/b4f23dc8eb9f40ae8052832deabf36ca as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/b4f23dc8eb9f40ae8052832deabf36ca 2023-11-11 11:55:59,008 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4f23dc8eb9f40ae8052832deabf36ca 2023-11-11 11:55:59,008 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/b4f23dc8eb9f40ae8052832deabf36ca, entries=1, sequenceid=23, filesize=5.0 K 2023-11-11 11:55:59,008 INFO [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b19d52a117473d66e99268a1c6bad959 in 1698ms, sequenceid=23, compaction requested=true 2023-11-11 11:55:59,009 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b19d52a117473d66e99268a1c6bad959: 2023-11-11 11:55:59,009 DEBUG [rs(jenkins-hbase4.apache.org,41363,1699703601801)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:55:59,009 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-11 11:55:59,009 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-11 11:55:59,009 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,009 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-11 11:55:59,009 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-11 11:55:59,010 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,010 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:59,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:59,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:59,011 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:59,011 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-11 11:55:59,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:59,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:59,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:59,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:59,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41363,1699703601801' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-11 11:55:59,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3534aabc[Count = 0] remaining members to acquire global barrier 2023-11-11 11:55:59,012 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-11 11:55:59,012 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:59,013 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:59,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:59,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:59,013 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-11 11:55:59,013 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-11 11:55:59,013 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41363,1699703601801' in zk 2023-11-11 11:55:59,013 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,013 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-11 11:55:59,015 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,015 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-11 11:55:59,015 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:59,015 DEBUG [member: 'jenkins-hbase4.apache.org,41363,1699703601801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-11 11:55:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:59,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:59,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:59,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41363,1699703601801': 2023-11-11 11:55:59,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41363,1699703601801' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-11 11:55:59,017 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-11 11:55:59,017 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-11 11:55:59,017 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-11 11:55:59,017 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-11 11:55:59,017 INFO [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-11 11:55:59,020 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-11 11:55:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-11 11:55:59,020 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:59,020 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:59,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-11 11:55:59,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:59,020 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:59,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-11 11:55:59,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:59,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-11 11:55:59,022 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-11 11:55:59,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,024 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,024 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:59,024 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-11 11:55:59,024 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-11 11:55:59,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-11 11:55:59,024 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:55:59,024 DEBUG [(jenkins-hbase4.apache.org,41929,1699703600606)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-11 11:55:59,024 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-11 11:55:59,024 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:59,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-11 11:55:59,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-11 11:55:59,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-11 11:55:59,024 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-11 11:55:59,024 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-11 11:55:59,024 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-11 11:55:59,024 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-11 11:55:59,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-11 11:55:59,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-11 11:55:59,124 DEBUG [Listener at localhost/39241] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-11 11:55:59,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41929] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-11 11:55:59,125 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:55:59,126 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): 1eb247784cfa55755a7f620156352c34/family1 is initiating major compaction (all files) 2023-11-11 11:55:59,126 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:55:59,126 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:55:59,126 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of 1eb247784cfa55755a7f620156352c34/family1 in testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:55:59,126 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/e37c2a71301c46699b5bf48834c5066b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/f071dfbb41f5432085a1b6fd0fa83865, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/44c501da2f4b40bcb53646faaf88f0f5, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/d712291b08cd4552a8933b3550947376, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/9131ccd095f34a39ba9168524f4ad942] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp, totalSize=27.1 K 2023-11-11 11:55:59,127 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting e37c2a71301c46699b5bf48834c5066b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703750825 2023-11-11 11:55:59,127 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting f071dfbb41f5432085a1b6fd0fa83865, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703752702 2023-11-11 11:55:59,127 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 44c501da2f4b40bcb53646faaf88f0f5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703754209 2023-11-11 11:55:59,128 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting d712291b08cd4552a8933b3550947376, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703755676 2023-11-11 11:55:59,128 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 9131ccd095f34a39ba9168524f4ad942, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 11:55:59,139 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): 1eb247784cfa55755a7f620156352c34#family1#compaction#197 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:55:59,576 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231111d31dbf980b7e4484930fff5e70babe6f_del 2023-11-11 11:55:59,577 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231111d31dbf980b7e4484930fff5e70babe6f_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111d31dbf980b7e4484930fff5e70babe6f_del 2023-11-11 11:56:00,428 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 681d1021069842c6bb042db8dc8f541c 2023-11-11 11:56:00,429 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family1/681d1021069842c6bb042db8dc8f541c as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/681d1021069842c6bb042db8dc8f541c 2023-11-11 11:56:00,450 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 681d1021069842c6bb042db8dc8f541c 2023-11-11 11:56:00,451 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1eb247784cfa55755a7f620156352c34/family1 of 1eb247784cfa55755a7f620156352c34 into 681d1021069842c6bb042db8dc8f541c(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:56:00,451 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for 1eb247784cfa55755a7f620156352c34: 2023-11-11 11:56:00,451 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:56:00,451 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): 1eb247784cfa55755a7f620156352c34/family2 is initiating major compaction (all files) 2023-11-11 11:56:00,452 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:56:00,452 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:56:00,452 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of 1eb247784cfa55755a7f620156352c34/family2 in testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:56:00,452 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/45c75266c870417f872f3323211bd7c2, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/c371378ededc49b7a5896990cfb2328e, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/3fb9175264594b2b8aa67eb1041c9ffd, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/1b728decab704b0388a01c5ffa546df3, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/e2db23cce1d149899989a2198491c209] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp, totalSize=25.4 K 2023-11-11 11:56:00,452 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 45c75266c870417f872f3323211bd7c2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703750825 2023-11-11 11:56:00,453 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting c371378ededc49b7a5896990cfb2328e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703752702 2023-11-11 11:56:00,453 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 3fb9175264594b2b8aa67eb1041c9ffd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703754209 2023-11-11 11:56:00,453 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 1b728decab704b0388a01c5ffa546df3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703755676 2023-11-11 11:56:00,454 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting e2db23cce1d149899989a2198491c209, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 11:56:00,461 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): 1eb247784cfa55755a7f620156352c34#family2#compaction#198 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:56:00,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/e37c2a71301c46699b5bf48834c5066b, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/f071dfbb41f5432085a1b6fd0fa83865, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/44c501da2f4b40bcb53646faaf88f0f5, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/d712291b08cd4552a8933b3550947376, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/9131ccd095f34a39ba9168524f4ad942] to archive 2023-11-11 11:56:00,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:56:00,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/e37c2a71301c46699b5bf48834c5066b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/e37c2a71301c46699b5bf48834c5066b 2023-11-11 11:56:00,468 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/f071dfbb41f5432085a1b6fd0fa83865 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/f071dfbb41f5432085a1b6fd0fa83865 2023-11-11 11:56:00,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/44c501da2f4b40bcb53646faaf88f0f5 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/44c501da2f4b40bcb53646faaf88f0f5 2023-11-11 11:56:00,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/d712291b08cd4552a8933b3550947376 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/d712291b08cd4552a8933b3550947376 2023-11-11 11:56:00,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/9131ccd095f34a39ba9168524f4ad942 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/9131ccd095f34a39ba9168524f4ad942 2023-11-11 11:56:00,868 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311111b568da5a71548c0a0c4ca2556a57cbb_del 2023-11-11 11:56:00,868 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311111b568da5a71548c0a0c4ca2556a57cbb_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311111b568da5a71548c0a0c4ca2556a57cbb_del 2023-11-11 11:56:01,680 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c3b5249a2f04ed89332071261214843 2023-11-11 11:56:01,681 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/.tmp/family2/2c3b5249a2f04ed89332071261214843 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/2c3b5249a2f04ed89332071261214843 2023-11-11 11:56:01,684 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c3b5249a2f04ed89332071261214843 2023-11-11 11:56:01,685 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1eb247784cfa55755a7f620156352c34/family2 of 1eb247784cfa55755a7f620156352c34 into 2c3b5249a2f04ed89332071261214843(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:56:01,685 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for 1eb247784cfa55755a7f620156352c34: 2023-11-11 11:56:01,685 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:56:01,686 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): 28c60b0dc97aae34619aed28ea7e61f0/family1 is initiating major compaction (all files) 2023-11-11 11:56:01,686 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:56:01,686 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:56:01,688 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of 28c60b0dc97aae34619aed28ea7e61f0/family1 in testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:56:01,688 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/30fbe3d778594fea925d5ed59461f622, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/b5956d6cf724464eba657ade4687edbb, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/f2af5478176a4bc2b4dc9554e348403a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/cb109bc42f0f45cfa5fce47018b436f5, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/f16fdd1a252c491da524bfb126961c04] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp, totalSize=27.1 K 2023-11-11 11:56:01,688 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 30fbe3d778594fea925d5ed59461f622, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703750825 2023-11-11 11:56:01,689 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting b5956d6cf724464eba657ade4687edbb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703752702 2023-11-11 11:56:01,689 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting f2af5478176a4bc2b4dc9554e348403a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703754209 2023-11-11 11:56:01,689 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting cb109bc42f0f45cfa5fce47018b436f5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703755675 2023-11-11 11:56:01,690 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting f16fdd1a252c491da524bfb126961c04, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 11:56:01,697 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): 28c60b0dc97aae34619aed28ea7e61f0#family1#compaction#199 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:56:01,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/45c75266c870417f872f3323211bd7c2, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/c371378ededc49b7a5896990cfb2328e, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/3fb9175264594b2b8aa67eb1041c9ffd, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/1b728decab704b0388a01c5ffa546df3, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/e2db23cce1d149899989a2198491c209] to archive 2023-11-11 11:56:01,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:56:01,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/45c75266c870417f872f3323211bd7c2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/45c75266c870417f872f3323211bd7c2 2023-11-11 11:56:01,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/c371378ededc49b7a5896990cfb2328e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/c371378ededc49b7a5896990cfb2328e 2023-11-11 11:56:01,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/3fb9175264594b2b8aa67eb1041c9ffd to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/3fb9175264594b2b8aa67eb1041c9ffd 2023-11-11 11:56:01,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/1b728decab704b0388a01c5ffa546df3 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/1b728decab704b0388a01c5ffa546df3 2023-11-11 11:56:01,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/e2db23cce1d149899989a2198491c209 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family2/e2db23cce1d149899989a2198491c209 2023-11-11 11:56:02,139 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111196e772dd4ffe4ebb87ce7fc14fc3ef05_del 2023-11-11 11:56:02,139 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111196e772dd4ffe4ebb87ce7fc14fc3ef05_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111196e772dd4ffe4ebb87ce7fc14fc3ef05_del 2023-11-11 11:56:02,995 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0680619d3ec446eb7e9d71e105e26f8 2023-11-11 11:56:02,995 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family1/a0680619d3ec446eb7e9d71e105e26f8 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/a0680619d3ec446eb7e9d71e105e26f8 2023-11-11 11:56:03,016 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0680619d3ec446eb7e9d71e105e26f8 2023-11-11 11:56:03,017 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 28c60b0dc97aae34619aed28ea7e61f0/family1 of 28c60b0dc97aae34619aed28ea7e61f0 into a0680619d3ec446eb7e9d71e105e26f8(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:56:03,017 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for 28c60b0dc97aae34619aed28ea7e61f0: 2023-11-11 11:56:03,017 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:56:03,018 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): 28c60b0dc97aae34619aed28ea7e61f0/family2 is initiating major compaction (all files) 2023-11-11 11:56:03,018 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:56:03,018 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:56:03,019 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of 28c60b0dc97aae34619aed28ea7e61f0/family2 in testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:56:03,019 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/eebf81b69b454912a1bfdca18c1c8d10, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/a313d0b01b7d47fa973fff03f3f21fd0, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/933324546c16470d9a1b4f8e9a69c5ba, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/99f669c9619e404c81a1770fddcdd84f, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/1fc0aeff198b49028c385b5b1c28037b] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp, totalSize=25.4 K 2023-11-11 11:56:03,019 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting eebf81b69b454912a1bfdca18c1c8d10, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703750825 2023-11-11 11:56:03,020 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting a313d0b01b7d47fa973fff03f3f21fd0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703752702 2023-11-11 11:56:03,020 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 933324546c16470d9a1b4f8e9a69c5ba, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703754209 2023-11-11 11:56:03,020 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 99f669c9619e404c81a1770fddcdd84f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703755675 2023-11-11 11:56:03,020 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 1fc0aeff198b49028c385b5b1c28037b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 11:56:03,027 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): 28c60b0dc97aae34619aed28ea7e61f0#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:56:03,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/30fbe3d778594fea925d5ed59461f622, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/b5956d6cf724464eba657ade4687edbb, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/f2af5478176a4bc2b4dc9554e348403a, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/cb109bc42f0f45cfa5fce47018b436f5, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/f16fdd1a252c491da524bfb126961c04] to archive 2023-11-11 11:56:03,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:56:03,068 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/30fbe3d778594fea925d5ed59461f622 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/30fbe3d778594fea925d5ed59461f622 2023-11-11 11:56:03,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/b5956d6cf724464eba657ade4687edbb to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/b5956d6cf724464eba657ade4687edbb 2023-11-11 11:56:03,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/f2af5478176a4bc2b4dc9554e348403a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/f2af5478176a4bc2b4dc9554e348403a 2023-11-11 11:56:03,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/cb109bc42f0f45cfa5fce47018b436f5 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/cb109bc42f0f45cfa5fce47018b436f5 2023-11-11 11:56:03,072 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/f16fdd1a252c491da524bfb126961c04 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/f16fdd1a252c491da524bfb126961c04 2023-11-11 11:56:03,438 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111105566f8a35bf4ee79c435eb005656941_del 2023-11-11 11:56:03,438 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111105566f8a35bf4ee79c435eb005656941_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023111105566f8a35bf4ee79c435eb005656941_del 2023-11-11 11:56:04,251 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ff67dcecb95454c894f5bc946af799b 2023-11-11 11:56:04,252 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/.tmp/family2/1ff67dcecb95454c894f5bc946af799b as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/1ff67dcecb95454c894f5bc946af799b 2023-11-11 11:56:04,255 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ff67dcecb95454c894f5bc946af799b 2023-11-11 11:56:04,256 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 28c60b0dc97aae34619aed28ea7e61f0/family2 of 28c60b0dc97aae34619aed28ea7e61f0 into 1ff67dcecb95454c894f5bc946af799b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:56:04,256 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for 28c60b0dc97aae34619aed28ea7e61f0: 2023-11-11 11:56:04,256 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:56:04,256 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): b19d52a117473d66e99268a1c6bad959/family1 is initiating major compaction (all files) 2023-11-11 11:56:04,256 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:56:04,256 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:56:04,257 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of b19d52a117473d66e99268a1c6bad959/family1 in testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:56:04,257 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/80b796940cee47a696de68fafda58ce3, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/2ded254d8b8f478a8aac8285c41703f7, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/23b454b769c047d488f0fee16605cbce, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/7f18d9fd3dd148fe8cad5cf6cc0c395e, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/8915621b836547c6a15d9e3ae53ba74d] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp, totalSize=27.1 K 2023-11-11 11:56:04,257 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 80b796940cee47a696de68fafda58ce3, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703750824 2023-11-11 11:56:04,257 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 2ded254d8b8f478a8aac8285c41703f7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703752701 2023-11-11 11:56:04,258 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 23b454b769c047d488f0fee16605cbce, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703754208 2023-11-11 11:56:04,258 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 7f18d9fd3dd148fe8cad5cf6cc0c395e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703755675 2023-11-11 11:56:04,258 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 8915621b836547c6a15d9e3ae53ba74d, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 11:56:04,265 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/eebf81b69b454912a1bfdca18c1c8d10, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/a313d0b01b7d47fa973fff03f3f21fd0, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/933324546c16470d9a1b4f8e9a69c5ba, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/99f669c9619e404c81a1770fddcdd84f, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/1fc0aeff198b49028c385b5b1c28037b] to archive 2023-11-11 11:56:04,266 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:56:04,266 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): b19d52a117473d66e99268a1c6bad959#family1#compaction#201 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:56:04,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/eebf81b69b454912a1bfdca18c1c8d10 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/eebf81b69b454912a1bfdca18c1c8d10 2023-11-11 11:56:04,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/a313d0b01b7d47fa973fff03f3f21fd0 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/a313d0b01b7d47fa973fff03f3f21fd0 2023-11-11 11:56:04,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/933324546c16470d9a1b4f8e9a69c5ba to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/933324546c16470d9a1b4f8e9a69c5ba 2023-11-11 11:56:04,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/99f669c9619e404c81a1770fddcdd84f to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/99f669c9619e404c81a1770fddcdd84f 2023-11-11 11:56:04,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/1fc0aeff198b49028c385b5b1c28037b to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family2/1fc0aeff198b49028c385b5b1c28037b 2023-11-11 11:56:04,708 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111162fa20d1ed9d4753a5aad112d2f86f76_del 2023-11-11 11:56:04,708 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111162fa20d1ed9d4753a5aad112d2f86f76_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111162fa20d1ed9d4753a5aad112d2f86f76_del 2023-11-11 11:56:05,158 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1a0bfb407be43c69368d16978e1fb45 2023-11-11 11:56:05,159 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family1/a1a0bfb407be43c69368d16978e1fb45 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/a1a0bfb407be43c69368d16978e1fb45 2023-11-11 11:56:05,180 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1a0bfb407be43c69368d16978e1fb45 2023-11-11 11:56:05,181 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b19d52a117473d66e99268a1c6bad959/family1 of b19d52a117473d66e99268a1c6bad959 into a1a0bfb407be43c69368d16978e1fb45(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-11 11:56:05,181 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for b19d52a117473d66e99268a1c6bad959: 2023-11-11 11:56:05,181 DEBUG [Listener at localhost/39241] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-11 11:56:05,181 DEBUG [Listener at localhost/39241] regionserver.HStore(1912): b19d52a117473d66e99268a1c6bad959/family2 is initiating major compaction (all files) 2023-11-11 11:56:05,181 INFO [Listener at localhost/39241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-11 11:56:05,181 INFO [Listener at localhost/39241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-11 11:56:05,181 INFO [Listener at localhost/39241] regionserver.HRegion(2259): Starting compaction of b19d52a117473d66e99268a1c6bad959/family2 in testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:56:05,181 INFO [Listener at localhost/39241] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/f05b57e0781842129406541da1e2aefe, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/3e71947a813e4e4aa1e9ebe4259686b1, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/efeba7938eca460a90da937536e0140d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/4ddbc17ca15346f9bfebb2da19023149, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/b4f23dc8eb9f40ae8052832deabf36ca] into tmpdir=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp, totalSize=25.4 K 2023-11-11 11:56:05,182 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting f05b57e0781842129406541da1e2aefe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699703750824 2023-11-11 11:56:05,182 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 3e71947a813e4e4aa1e9ebe4259686b1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699703752701 2023-11-11 11:56:05,183 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting efeba7938eca460a90da937536e0140d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699703754208 2023-11-11 11:56:05,183 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting 4ddbc17ca15346f9bfebb2da19023149, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699703755675 2023-11-11 11:56:05,183 DEBUG [Listener at localhost/39241] compactions.Compactor(207): Compacting b4f23dc8eb9f40ae8052832deabf36ca, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-11 11:56:05,191 INFO [Listener at localhost/39241] throttle.PressureAwareThroughputController(145): b19d52a117473d66e99268a1c6bad959#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-11 11:56:05,265 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/80b796940cee47a696de68fafda58ce3, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/2ded254d8b8f478a8aac8285c41703f7, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/23b454b769c047d488f0fee16605cbce, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/7f18d9fd3dd148fe8cad5cf6cc0c395e, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/8915621b836547c6a15d9e3ae53ba74d] to archive 2023-11-11 11:56:05,266 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:56:05,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/80b796940cee47a696de68fafda58ce3 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/80b796940cee47a696de68fafda58ce3 2023-11-11 11:56:05,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/2ded254d8b8f478a8aac8285c41703f7 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/2ded254d8b8f478a8aac8285c41703f7 2023-11-11 11:56:05,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/23b454b769c047d488f0fee16605cbce to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/23b454b769c047d488f0fee16605cbce 2023-11-11 11:56:05,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/7f18d9fd3dd148fe8cad5cf6cc0c395e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/7f18d9fd3dd148fe8cad5cf6cc0c395e 2023-11-11 11:56:05,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/8915621b836547c6a15d9e3ae53ba74d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/8915621b836547c6a15d9e3ae53ba74d 2023-11-11 11:56:05,598 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231111c364d6440dbc406caa91e110d1018bf2_del 2023-11-11 11:56:05,598 INFO [Listener at localhost/39241] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231111c364d6440dbc406caa91e110d1018bf2_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231111c364d6440dbc406caa91e110d1018bf2_del 2023-11-11 11:56:05,862 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-11 11:56:06,411 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 525626864ac34c55b397ca489890c394 2023-11-11 11:56:06,411 DEBUG [Listener at localhost/39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/.tmp/family2/525626864ac34c55b397ca489890c394 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/525626864ac34c55b397ca489890c394 2023-11-11 11:56:06,415 INFO [Listener at localhost/39241] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 525626864ac34c55b397ca489890c394 2023-11-11 11:56:06,415 INFO [Listener at localhost/39241] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b19d52a117473d66e99268a1c6bad959/family2 of b19d52a117473d66e99268a1c6bad959 into 525626864ac34c55b397ca489890c394(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-11 11:56:06,415 DEBUG [Listener at localhost/39241] regionserver.HRegion(2289): Compaction status journal for b19d52a117473d66e99268a1c6bad959: 2023-11-11 11:56:06,419 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:56:06,422 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:56:06,425 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:56:06,426 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:56:06,430 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41929] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA2e\x02w\xBC\xFAb\x86\xF6\xBAj\x9Db/\xDB\x04"\x10l\x05\x877.\x86\x92\xD9\xF4\xF2#\xCFc\x8F?g*\x101\xE5G7\xAC\xDF\xC8\xD0\xBB\x93\xB5\xFEa+\xDF\x972\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-11 11:56:06,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-11 11:56:06,452 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-11 11:56:06,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:56:06,452 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699704366452 2023-11-11 11:56:06,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-11 11:56:06,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/f05b57e0781842129406541da1e2aefe, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/3e71947a813e4e4aa1e9ebe4259686b1, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/efeba7938eca460a90da937536e0140d, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/4ddbc17ca15346f9bfebb2da19023149, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/b4f23dc8eb9f40ae8052832deabf36ca] to archive 2023-11-11 11:56:06,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:56:06,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/f05b57e0781842129406541da1e2aefe to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/f05b57e0781842129406541da1e2aefe 2023-11-11 11:56:06,468 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/3e71947a813e4e4aa1e9ebe4259686b1 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/3e71947a813e4e4aa1e9ebe4259686b1 2023-11-11 11:56:06,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/efeba7938eca460a90da937536e0140d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/efeba7938eca460a90da937536e0140d 2023-11-11 11:56:06,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/4ddbc17ca15346f9bfebb2da19023149 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/4ddbc17ca15346f9bfebb2da19023149 2023-11-11 11:56:06,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/b4f23dc8eb9f40ae8052832deabf36ca to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family2/b4f23dc8eb9f40ae8052832deabf36ca 2023-11-11 11:56:06,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-11 11:56:06,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111162fa20d1ed9d4753a5aad112d2f86f76_del 2023-11-11 11:56:06,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111196e772dd4ffe4ebb87ce7fc14fc3ef05_del 2023-11-11 11:56:06,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231111d31dbf980b7e4484930fff5e70babe6f_del 2023-11-11 11:56:06,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 11:56:06,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] zookeeper.ReadOnlyZKClient(139): Connect 0x02856d9b to 127.0.0.1:59344 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-11 11:56:06,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75227612, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-11 11:56:06,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231111 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 11:56:07,399 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111183d2aff36dd24cc0bcab82b6e655b69a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111183d2aff36dd24cc0bcab82b6e655b69a 2023-11-11 11:56:07,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 11:56:07,410 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-11 11:56:07,412 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-11 11:56:07,420 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-11 11:56:07,421 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-11 11:56:07,453 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231111/family1/6268a6ec04b44fa6a1c7bd4ff72eb59d first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-11 11:56:07,454 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231111/family1/6268a6ec04b44fa6a1c7bd4ff72eb59d}] 2023-11-11 11:56:07,460 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231111/family1/6268a6ec04b44fa6a1c7bd4ff72eb59d for inclusion in 1eb247784cfa55755a7f620156352c34/family1 2023-11-11 11:56:07,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-11 11:56:07,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-11 11:56:07,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 1eb247784cfa55755a7f620156352c34: 2023-11-11 11:56:07,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231111/family1/6268a6ec04b44fa6a1c7bd4ff72eb59d to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__sl0pshqdvau5nmn0qm0j53btc84kvi9uufm143ktc7gl1fdtq008o71ij4sdseha/family1/6268a6ec04b44fa6a1c7bd4ff72eb59d 2023-11-11 11:56:07,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__sl0pshqdvau5nmn0qm0j53btc84kvi9uufm143ktc7gl1fdtq008o71ij4sdseha/family1/6268a6ec04b44fa6a1c7bd4ff72eb59d as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/361723f89def48a6ba8429f7b9a17d48_SeqId_28_ 2023-11-11 11:56:07,484 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__sl0pshqdvau5nmn0qm0j53btc84kvi9uufm143ktc7gl1fdtq008o71ij4sdseha/family1/6268a6ec04b44fa6a1c7bd4ff72eb59d into 1eb247784cfa55755a7f620156352c34/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/361723f89def48a6ba8429f7b9a17d48_SeqId_28_ - updating store file list. 2023-11-11 11:56:07,506 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/361723f89def48a6ba8429f7b9a17d48_SeqId_28_ into 1eb247784cfa55755a7f620156352c34/family1 2023-11-11 11:56:07,506 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__sl0pshqdvau5nmn0qm0j53btc84kvi9uufm143ktc7gl1fdtq008o71ij4sdseha/family1/6268a6ec04b44fa6a1c7bd4ff72eb59d into 1eb247784cfa55755a7f620156352c34/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/family1/361723f89def48a6ba8429f7b9a17d48_SeqId_28_) 2023-11-11 11:56:07,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__sl0pshqdvau5nmn0qm0j53btc84kvi9uufm143ktc7gl1fdtq008o71ij4sdseha/family1/6268a6ec04b44fa6a1c7bd4ff72eb59d 2023-11-11 11:56:07,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231111 table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 11:56:07,509 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:56:07,510 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111139ab0c1b0eef4b81b3fb62e8ce602153 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111139ab0c1b0eef4b81b3fb62e8ce602153 2023-11-11 11:56:07,511 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111686011b970e043848debf0f72c834573 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111686011b970e043848debf0f72c834573 2023-11-11 11:56:07,513 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311118f64d318211c43df848b24762a8788be to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311118f64d318211c43df848b24762a8788be 2023-11-11 11:56:07,514 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111f751d2fe1cc546deb833b71c05dc2548 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111f751d2fe1cc546deb833b71c05dc2548 2023-11-11 11:56:07,514 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-11 11:56:07,514 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231111' 2023-11-11 11:56:07,514 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231111 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 11:56:07,514 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231111 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 11:56:08,473 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311113b012689a82e483d84360f8c4408c8a2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311113b012689a82e483d84360f8c4408c8a2 2023-11-11 11:56:08,474 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 11:56:08,514 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231111/family1/ec83e9576125487797a5e53eb8242490 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-11 11:56:08,515 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231111/family1/ec83e9576125487797a5e53eb8242490}] 2023-11-11 11:56:08,517 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231111/family1/ec83e9576125487797a5e53eb8242490 for inclusion in 28c60b0dc97aae34619aed28ea7e61f0/family1 2023-11-11 11:56:08,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-11 11:56:08,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-11 11:56:08,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for 28c60b0dc97aae34619aed28ea7e61f0: 2023-11-11 11:56:08,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231111/family1/ec83e9576125487797a5e53eb8242490 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__u4pthtkip46k4modritim2p17c2up4pgl65lieismuaji0c37vd1n263q2v4k8do/family1/ec83e9576125487797a5e53eb8242490 2023-11-11 11:56:08,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__u4pthtkip46k4modritim2p17c2up4pgl65lieismuaji0c37vd1n263q2v4k8do/family1/ec83e9576125487797a5e53eb8242490 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/a9ba2c36e00d4baea512113b209294d0_SeqId_28_ 2023-11-11 11:56:08,552 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__u4pthtkip46k4modritim2p17c2up4pgl65lieismuaji0c37vd1n263q2v4k8do/family1/ec83e9576125487797a5e53eb8242490 into 28c60b0dc97aae34619aed28ea7e61f0/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/a9ba2c36e00d4baea512113b209294d0_SeqId_28_ - updating store file list. 2023-11-11 11:56:08,575 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/a9ba2c36e00d4baea512113b209294d0_SeqId_28_ into 28c60b0dc97aae34619aed28ea7e61f0/family1 2023-11-11 11:56:08,575 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__u4pthtkip46k4modritim2p17c2up4pgl65lieismuaji0c37vd1n263q2v4k8do/family1/ec83e9576125487797a5e53eb8242490 into 28c60b0dc97aae34619aed28ea7e61f0/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/family1/a9ba2c36e00d4baea512113b209294d0_SeqId_28_) 2023-11-11 11:56:08,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__u4pthtkip46k4modritim2p17c2up4pgl65lieismuaji0c37vd1n263q2v4k8do/family1/ec83e9576125487797a5e53eb8242490 2023-11-11 11:56:08,577 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231111 table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 11:56:08,578 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:56:08,579 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111135b89eec27dc4442abf96c4f560a2545 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111135b89eec27dc4442abf96c4f560a2545 2023-11-11 11:56:08,580 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311113d027b9564fb4b69af1947c403eb9184 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311113d027b9564fb4b69af1947c403eb9184 2023-11-11 11:56:08,581 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311115155105daa8a465c9404b908bac679c2 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311115155105daa8a465c9404b908bac679c2 2023-11-11 11:56:08,582 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111196aea548cf654a71ad9e6dee28fe9b23 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111196aea548cf654a71ad9e6dee28fe9b23 2023-11-11 11:56:08,582 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-11 11:56:08,582 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231111' 2023-11-11 11:56:08,582 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231111 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 11:56:08,582 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231111 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 11:56:08,727 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311114d85f622ac094c3a9fbc13bd65d3bf8a to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311114d85f622ac094c3a9fbc13bd65d3bf8a 2023-11-11 11:56:08,728 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 11:56:08,767 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231111/family1/612d1874799c4628b4c1cdbef2dda85e first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-11 11:56:08,768 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959., hostname=jenkins-hbase4.apache.org,41363,1699703601801, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231111/family1/612d1874799c4628b4c1cdbef2dda85e}] 2023-11-11 11:56:08,770 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(763): Validating hfile at hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231111/family1/612d1874799c4628b4c1cdbef2dda85e for inclusion in b19d52a117473d66e99268a1c6bad959/family1 2023-11-11 11:56:08,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-11 11:56:08,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(777): Region bounds: first= last=1 2023-11-11 11:56:08,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegion(2446): Flush status journal for b19d52a117473d66e99268a1c6bad959: 2023-11-11 11:56:08,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231111/family1/612d1874799c4628b4c1cdbef2dda85e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__6i35sm4d73rdsfishb7q3iptfg2rk9vpem90nsr9attjaschqg2an7cu48aapoac/family1/612d1874799c4628b4c1cdbef2dda85e 2023-11-11 11:56:08,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__6i35sm4d73rdsfishb7q3iptfg2rk9vpem90nsr9attjaschqg2an7cu48aapoac/family1/612d1874799c4628b4c1cdbef2dda85e as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/da5070c993fb44e1b5d3ec92596ed4ea_SeqId_28_ 2023-11-11 11:56:08,793 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(849): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__6i35sm4d73rdsfishb7q3iptfg2rk9vpem90nsr9attjaschqg2an7cu48aapoac/family1/612d1874799c4628b4c1cdbef2dda85e into b19d52a117473d66e99268a1c6bad959/family1 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/da5070c993fb44e1b5d3ec92596ed4ea_SeqId_28_ - updating store file list. 2023-11-11 11:56:08,815 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(882): Loaded HFile hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/da5070c993fb44e1b5d3ec92596ed4ea_SeqId_28_ into b19d52a117473d66e99268a1c6bad959/family1 2023-11-11 11:56:08,815 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.HStore(855): Successfully loaded hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__6i35sm4d73rdsfishb7q3iptfg2rk9vpem90nsr9attjaschqg2an7cu48aapoac/family1/612d1874799c4628b4c1cdbef2dda85e into b19d52a117473d66e99268a1c6bad959/family1 (new location: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/family1/da5070c993fb44e1b5d3ec92596ed4ea_SeqId_28_) 2023-11-11 11:56:08,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=41363] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/staging/jenkins__testMajorCompactionFromAdmin__6i35sm4d73rdsfishb7q3iptfg2rk9vpem90nsr9attjaschqg2an7cu48aapoac/family1/612d1874799c4628b4c1cdbef2dda85e 2023-11-11 11:56:08,817 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231111 table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 11:56:08,817 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:56:08,819 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111aef7de56be334ff79933794007ea727e to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111aef7de56be334ff79933794007ea727e 2023-11-11 11:56:08,820 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111c15c0c3bbe0e4a25b7ee9548e7c1c4cb to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111c15c0c3bbe0e4a25b7ee9548e7c1c4cb 2023-11-11 11:56:08,820 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111d5e16cad7ff44ca0ab449c0fd235a2f4 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111d5e16cad7ff44ca0ab449c0fd235a2f4 2023-11-11 11:56:08,821 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111ef9fdfa64aa84b36b493c8f8b83dc486 to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231111ef9fdfa64aa84b36b493c8f8b83dc486 2023-11-11 11:56:08,821 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-11 11:56:08,821 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231111' 2023-11-11 11:56:08,822 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231111 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 11:56:08,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-11 11:56:08,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-11 11:56:08,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111162fa20d1ed9d4753a5aad112d2f86f76_del] 2023-11-11 11:56:08,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:56:08,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111162fa20d1ed9d4753a5aad112d2f86f76_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111162fa20d1ed9d4753a5aad112d2f86f76_del 2023-11-11 11:56:08,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-11 11:56:08,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111196e772dd4ffe4ebb87ce7fc14fc3ef05_del] 2023-11-11 11:56:08,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:56:08,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111196e772dd4ffe4ebb87ce7fc14fc3ef05_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111196e772dd4ffe4ebb87ce7fc14fc3ef05_del 2023-11-11 11:56:08,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-11 11:56:08,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111d31dbf980b7e4484930fff5e70babe6f_del] 2023-11-11 11:56:08,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] backup.HFileArchiver(360): Archiving compacted files. 2023-11-11 11:56:08,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111d31dbf980b7e4484930fff5e70babe6f_del to hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231111d31dbf980b7e4484930fff5e70babe6f_del 2023-11-11 11:56:08,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-11 11:56:08,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699703604781] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-11 11:56:08,828 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-11 11:56:08,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.3790 sec 2023-11-11 11:56:08,844 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:56:08,846 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:56:08,848 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-11 11:56:08,849 DEBUG [Listener at localhost/39241] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-11 11:56:08,853 INFO [Listener at localhost/39241] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-11 11:56:08,887 INFO [Listener at localhost/39241] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=250 (was 256), OpenFileDescriptor=665 (was 677), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=115 (was 122), ProcessCount=167 (was 167), AvailableMemoryMB=2423 (was 2429) 2023-11-11 11:56:08,888 DEBUG [Listener at localhost/39241] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65c25ebc to 127.0.0.1:59344 2023-11-11 11:56:08,888 DEBUG [Listener at localhost/39241] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:56:08,888 INFO [Listener at localhost/39241] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-11 11:56:08,888 INFO [Listener at localhost/39241] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-11 11:56:08,889 DEBUG [Listener at localhost/39241] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36d9c5a6 to 127.0.0.1:59344 2023-11-11 11:56:08,889 DEBUG [Listener at localhost/39241] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:56:08,889 DEBUG [Listener at localhost/39241] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-11 11:56:08,889 DEBUG [Listener at localhost/39241] util.JVMClusterUtil(257): Found active master hash=2092569855, stopped=false 2023-11-11 11:56:08,889 INFO [Listener at localhost/39241] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41929,1699703600606 2023-11-11 11:56:08,891 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-11 11:56:08,891 INFO [Listener at localhost/39241] procedure2.ProcedureExecutor(628): Stopping 2023-11-11 11:56:08,891 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-11 11:56:08,891 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 11:56:08,892 DEBUG [Listener at localhost/39241] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38950243 to 127.0.0.1:59344 2023-11-11 11:56:08,892 DEBUG [Listener at localhost/39241] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:56:08,892 INFO [Listener at localhost/39241] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41363,1699703601801' ***** 2023-11-11 11:56:08,892 INFO [Listener at localhost/39241] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-11 11:56:08,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-11 11:56:08,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-11 11:56:08,892 INFO [RS:0;jenkins-hbase4:41363] regionserver.HeapMemoryManager(220): Stopping 2023-11-11 11:56:08,892 INFO [RS:0;jenkins-hbase4:41363] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-11 11:56:08,892 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-11 11:56:08,892 INFO [RS:0;jenkins-hbase4:41363] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 1c8723faa7ff7c4e6452e98575c3f762 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 1eb247784cfa55755a7f620156352c34 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 99dc75f3ad72a9db7000d7e9e3c61b9e 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 147870233aed417eedc1252d62affc04 2023-11-11 11:56:08,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1c8723faa7ff7c4e6452e98575c3f762, disabling compactions & flushes 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 28c60b0dc97aae34619aed28ea7e61f0 2023-11-11 11:56:08,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 45cc680593870df452d4141fbb486a43 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 4a6a122edb2f0f032fe6b9e6c8ec2ec5 2023-11-11 11:56:08,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for c3c434dd053fdf95e98a3b778602f7ca 2023-11-11 11:56:08,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. after waiting 0 ms 2023-11-11 11:56:08,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 4f7134a0327c0d6a8485919c75653ebd 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 6903cfa11da17a1f47f8b48bb6976d76 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 8cb9f02ad3781aa733fd732e5fe19945 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 0cb4b137d2c1690927cb67dbaea29e17 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 5d9c8b45df92320cf0682076380e93a0 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for db6a44e3220a0eac47241b7eccc20166 2023-11-11 11:56:08,893 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 422a7de28554bf253a37f6e26541befc 2023-11-11 11:56:08,894 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 03486b38e1a188d7eb7cb528e5cecc21 2023-11-11 11:56:08,894 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for e83876f9f0be04ff0c4dd2585fadf76a 2023-11-11 11:56:08,894 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 998271c54a88643806fe1b6c1978d34b 2023-11-11 11:56:08,894 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for b19d52a117473d66e99268a1c6bad959 2023-11-11 11:56:08,894 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for be5c328b64d96b557d201a387d04fa34 2023-11-11 11:56:08,894 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:56:08,894 DEBUG [RS:0;jenkins-hbase4:41363] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a1f7a9c to 127.0.0.1:59344 2023-11-11 11:56:08,894 DEBUG [RS:0;jenkins-hbase4:41363] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:56:08,894 INFO [RS:0;jenkins-hbase4:41363] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-11 11:56:08,894 INFO [RS:0;jenkins-hbase4:41363] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-11 11:56:08,894 INFO [RS:0;jenkins-hbase4:41363] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-11 11:56:08,894 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-11 11:56:08,894 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-11 11:56:08,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-11 11:56:08,895 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-11 11:56:08,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-11 11:56:08,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-11 11:56:08,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-11 11:56:08,895 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-11 11:56:08,895 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1504): Waiting on 03486b38e1a188d7eb7cb528e5cecc21, 0cb4b137d2c1690927cb67dbaea29e17, 147870233aed417eedc1252d62affc04, 1588230740, 1c8723faa7ff7c4e6452e98575c3f762, 1eb247784cfa55755a7f620156352c34, 28c60b0dc97aae34619aed28ea7e61f0, 422a7de28554bf253a37f6e26541befc, 45cc680593870df452d4141fbb486a43, 4a6a122edb2f0f032fe6b9e6c8ec2ec5, 4f7134a0327c0d6a8485919c75653ebd, 5d9c8b45df92320cf0682076380e93a0, 6903cfa11da17a1f47f8b48bb6976d76, 8cb9f02ad3781aa733fd732e5fe19945, 998271c54a88643806fe1b6c1978d34b, 99dc75f3ad72a9db7000d7e9e3c61b9e, b19d52a117473d66e99268a1c6bad959, be5c328b64d96b557d201a387d04fa34, c3c434dd053fdf95e98a3b778602f7ca, db6a44e3220a0eac47241b7eccc20166, e83876f9f0be04ff0c4dd2585fadf76a 2023-11-11 11:56:08,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithMonthlyPolicy/1c8723faa7ff7c4e6452e98575c3f762/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-11 11:56:08,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:56:08,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1c8723faa7ff7c4e6452e98575c3f762: 2023-11-11 11:56:08,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1699703616509.1c8723faa7ff7c4e6452e98575c3f762. 2023-11-11 11:56:08,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1eb247784cfa55755a7f620156352c34, disabling compactions & flushes 2023-11-11 11:56:08,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:56:08,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:56:08,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. after waiting 0 ms 2023-11-11 11:56:08,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:56:08,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/1eb247784cfa55755a7f620156352c34/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-11 11:56:08,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:56:08,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1eb247784cfa55755a7f620156352c34: 2023-11-11 11:56:08,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1699703748679.1eb247784cfa55755a7f620156352c34. 2023-11-11 11:56:08,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 99dc75f3ad72a9db7000d7e9e3c61b9e, disabling compactions & flushes 2023-11-11 11:56:08,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:56:08,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:56:08,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. after waiting 0 ms 2023-11-11 11:56:08,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:56:08,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/99dc75f3ad72a9db7000d7e9e3c61b9e/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-11 11:56:08,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:56:08,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 99dc75f3ad72a9db7000d7e9e3c61b9e: 2023-11-11 11:56:08,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1699703692956.99dc75f3ad72a9db7000d7e9e3c61b9e. 2023-11-11 11:56:08,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 147870233aed417eedc1252d62affc04, disabling compactions & flushes 2023-11-11 11:56:08,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:56:08,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:56:08,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. after waiting 0 ms 2023-11-11 11:56:08,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:56:08,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithMonthlyPolicy/147870233aed417eedc1252d62affc04/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-11 11:56:08,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:56:08,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 147870233aed417eedc1252d62affc04: 2023-11-11 11:56:08,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1699703735687.147870233aed417eedc1252d62affc04. 2023-11-11 11:56:08,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 28c60b0dc97aae34619aed28ea7e61f0, disabling compactions & flushes 2023-11-11 11:56:08,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:56:08,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:56:08,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. after waiting 0 ms 2023-11-11 11:56:08,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:56:08,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/28c60b0dc97aae34619aed28ea7e61f0/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-11 11:56:08,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:56:08,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 28c60b0dc97aae34619aed28ea7e61f0: 2023-11-11 11:56:08,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1699703748679.28c60b0dc97aae34619aed28ea7e61f0. 2023-11-11 11:56:08,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 45cc680593870df452d4141fbb486a43, disabling compactions & flushes 2023-11-11 11:56:08,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:56:08,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:56:08,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. after waiting 0 ms 2023-11-11 11:56:08,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:56:08,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/45cc680593870df452d4141fbb486a43/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-11 11:56:08,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:56:08,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 45cc680593870df452d4141fbb486a43: 2023-11-11 11:56:08,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1699703718594.45cc680593870df452d4141fbb486a43. 2023-11-11 11:56:08,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4a6a122edb2f0f032fe6b9e6c8ec2ec5, disabling compactions & flushes 2023-11-11 11:56:08,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:56:08,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:56:08,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. after waiting 0 ms 2023-11-11 11:56:08,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:56:08,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMinorCompactionWithWeeklyPolicy/4a6a122edb2f0f032fe6b9e6c8ec2ec5/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-11 11:56:08,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:56:08,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4a6a122edb2f0f032fe6b9e6c8ec2ec5: 2023-11-11 11:56:08,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1699703628562.4a6a122edb2f0f032fe6b9e6c8ec2ec5. 2023-11-11 11:56:08,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c3c434dd053fdf95e98a3b778602f7ca, disabling compactions & flushes 2023-11-11 11:56:08,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:56:08,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:56:08,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. after waiting 0 ms 2023-11-11 11:56:08,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:56:08,923 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-11 11:56:08,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/c3c434dd053fdf95e98a3b778602f7ca/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-11 11:56:08,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:56:08,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c3c434dd053fdf95e98a3b778602f7ca: 2023-11-11 11:56:08,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1699703718594.c3c434dd053fdf95e98a3b778602f7ca. 2023-11-11 11:56:08,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4f7134a0327c0d6a8485919c75653ebd, disabling compactions & flushes 2023-11-11 11:56:08,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:56:08,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:56:08,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. after waiting 0 ms 2023-11-11 11:56:08,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:56:08,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/4f7134a0327c0d6a8485919c75653ebd/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-11 11:56:08,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:56:08,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4f7134a0327c0d6a8485919c75653ebd: 2023-11-11 11:56:08,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1699703640870.4f7134a0327c0d6a8485919c75653ebd. 2023-11-11 11:56:08,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6903cfa11da17a1f47f8b48bb6976d76, disabling compactions & flushes 2023-11-11 11:56:08,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:56:08,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:56:08,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. after waiting 0 ms 2023-11-11 11:56:08,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:56:08,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/6903cfa11da17a1f47f8b48bb6976d76/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-11 11:56:08,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:56:08,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6903cfa11da17a1f47f8b48bb6976d76: 2023-11-11 11:56:08,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1699703640870.6903cfa11da17a1f47f8b48bb6976d76. 2023-11-11 11:56:08,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8cb9f02ad3781aa733fd732e5fe19945, disabling compactions & flushes 2023-11-11 11:56:08,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:56:08,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:56:08,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. after waiting 0 ms 2023-11-11 11:56:08,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:56:08,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/ns/testMinorCompaction/8cb9f02ad3781aa733fd732e5fe19945/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-11 11:56:08,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:56:08,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8cb9f02ad3781aa733fd732e5fe19945: 2023-11-11 11:56:08,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1699703718594.8cb9f02ad3781aa733fd732e5fe19945. 2023-11-11 11:56:08,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0cb4b137d2c1690927cb67dbaea29e17, disabling compactions & flushes 2023-11-11 11:56:08,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:56:08,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:56:08,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. after waiting 0 ms 2023-11-11 11:56:08,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:56:08,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0cb4b137d2c1690927cb67dbaea29e17/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-11 11:56:08,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:56:08,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0cb4b137d2c1690927cb67dbaea29e17: 2023-11-11 11:56:08,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699703656529.0cb4b137d2c1690927cb67dbaea29e17. 2023-11-11 11:56:08,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5d9c8b45df92320cf0682076380e93a0, disabling compactions & flushes 2023-11-11 11:56:08,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. 2023-11-11 11:56:08,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. 2023-11-11 11:56:08,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. after waiting 0 ms 2023-11-11 11:56:08,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. 2023-11-11 11:56:08,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5d9c8b45df92320cf0682076380e93a0 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-11 11:56:08,964 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-11 11:56:09,096 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1504): Waiting on 03486b38e1a188d7eb7cb528e5cecc21, 1588230740, 422a7de28554bf253a37f6e26541befc, 5d9c8b45df92320cf0682076380e93a0, 998271c54a88643806fe1b6c1978d34b, b19d52a117473d66e99268a1c6bad959, be5c328b64d96b557d201a387d04fa34, db6a44e3220a0eac47241b7eccc20166, e83876f9f0be04ff0c4dd2585fadf76a 2023-11-11 11:56:09,137 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-11 11:56:09,137 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-11 11:56:09,296 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1504): Waiting on 03486b38e1a188d7eb7cb528e5cecc21, 1588230740, 422a7de28554bf253a37f6e26541befc, 5d9c8b45df92320cf0682076380e93a0, 998271c54a88643806fe1b6c1978d34b, b19d52a117473d66e99268a1c6bad959, be5c328b64d96b557d201a387d04fa34, db6a44e3220a0eac47241b7eccc20166, e83876f9f0be04ff0c4dd2585fadf76a 2023-11-11 11:56:09,306 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/.tmp/info/b003657ec6f54de58e7683c4324c293a 2023-11-11 11:56:09,310 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b003657ec6f54de58e7683c4324c293a 2023-11-11 11:56:09,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/namespace/5d9c8b45df92320cf0682076380e93a0/.tmp/info/46a067381d494db4a673e0f7fe2e30d7 2023-11-11 11:56:09,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/namespace/5d9c8b45df92320cf0682076380e93a0/.tmp/info/46a067381d494db4a673e0f7fe2e30d7 as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/namespace/5d9c8b45df92320cf0682076380e93a0/info/46a067381d494db4a673e0f7fe2e30d7 2023-11-11 11:56:09,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/namespace/5d9c8b45df92320cf0682076380e93a0/info/46a067381d494db4a673e0f7fe2e30d7, entries=3, sequenceid=7, filesize=4.8 K 2023-11-11 11:56:09,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 5d9c8b45df92320cf0682076380e93a0 in 415ms, sequenceid=7, compaction requested=false 2023-11-11 11:56:09,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/namespace/5d9c8b45df92320cf0682076380e93a0/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-11 11:56:09,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. 2023-11-11 11:56:09,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5d9c8b45df92320cf0682076380e93a0: 2023-11-11 11:56:09,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1699703603751.5d9c8b45df92320cf0682076380e93a0. 2023-11-11 11:56:09,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing db6a44e3220a0eac47241b7eccc20166, disabling compactions & flushes 2023-11-11 11:56:09,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:56:09,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:56:09,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. after waiting 0 ms 2023-11-11 11:56:09,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:56:09,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/db6a44e3220a0eac47241b7eccc20166/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-11 11:56:09,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:56:09,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for db6a44e3220a0eac47241b7eccc20166: 2023-11-11 11:56:09,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699703604996.db6a44e3220a0eac47241b7eccc20166. 2023-11-11 11:56:09,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 422a7de28554bf253a37f6e26541befc, disabling compactions & flushes 2023-11-11 11:56:09,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:56:09,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:56:09,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. after waiting 0 ms 2023-11-11 11:56:09,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:56:09,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testScannerOnBulkLoadRefHFiles/422a7de28554bf253a37f6e26541befc/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-11 11:56:09,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:56:09,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 422a7de28554bf253a37f6e26541befc: 2023-11-11 11:56:09,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1699703640870.422a7de28554bf253a37f6e26541befc. 2023-11-11 11:56:09,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 03486b38e1a188d7eb7cb528e5cecc21, disabling compactions & flushes 2023-11-11 11:56:09,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:56:09,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:56:09,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. after waiting 0 ms 2023-11-11 11:56:09,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:56:09,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/03486b38e1a188d7eb7cb528e5cecc21/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-11 11:56:09,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:56:09,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 03486b38e1a188d7eb7cb528e5cecc21: 2023-11-11 11:56:09,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699703671553.03486b38e1a188d7eb7cb528e5cecc21. 2023-11-11 11:56:09,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e83876f9f0be04ff0c4dd2585fadf76a, disabling compactions & flushes 2023-11-11 11:56:09,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:56:09,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:56:09,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. after waiting 0 ms 2023-11-11 11:56:09,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:56:09,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionWithWeeklyPolicy/e83876f9f0be04ff0c4dd2585fadf76a/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-11 11:56:09,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:56:09,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e83876f9f0be04ff0c4dd2585fadf76a: 2023-11-11 11:56:09,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1699703645878.e83876f9f0be04ff0c4dd2585fadf76a. 2023-11-11 11:56:09,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 998271c54a88643806fe1b6c1978d34b, disabling compactions & flushes 2023-11-11 11:56:09,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:56:09,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:56:09,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. after waiting 0 ms 2023-11-11 11:56:09,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:56:09,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/998271c54a88643806fe1b6c1978d34b/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-11 11:56:09,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:56:09,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 998271c54a88643806fe1b6c1978d34b: 2023-11-11 11:56:09,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1699703692956.998271c54a88643806fe1b6c1978d34b. 2023-11-11 11:56:09,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b19d52a117473d66e99268a1c6bad959, disabling compactions & flushes 2023-11-11 11:56:09,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:56:09,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:56:09,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. after waiting 0 ms 2023-11-11 11:56:09,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:56:09,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testMajorCompactionFromAdmin/b19d52a117473d66e99268a1c6bad959/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-11 11:56:09,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:56:09,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b19d52a117473d66e99268a1c6bad959: 2023-11-11 11:56:09,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1699703748679.b19d52a117473d66e99268a1c6bad959. 2023-11-11 11:56:09,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing be5c328b64d96b557d201a387d04fa34, disabling compactions & flushes 2023-11-11 11:56:09,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:56:09,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:56:09,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. after waiting 0 ms 2023-11-11 11:56:09,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:56:09,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/default/testCompactionWithHFileLink/be5c328b64d96b557d201a387d04fa34/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-11 11:56:09,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:56:09,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for be5c328b64d96b557d201a387d04fa34: 2023-11-11 11:56:09,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1699703692956.be5c328b64d96b557d201a387d04fa34. 2023-11-11 11:56:09,496 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-11 11:56:09,696 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-11 11:56:09,717 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/.tmp/rep_barrier/65a16df202fa4e99ac9e77b608bc3dff 2023-11-11 11:56:09,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65a16df202fa4e99ac9e77b608bc3dff 2023-11-11 11:56:09,897 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-11-11 11:56:09,897 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-11-11 11:56:09,897 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-11 11:56:10,097 DEBUG [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-11 11:56:10,129 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/.tmp/table/af8727a23d944548a678ca415ad561fe 2023-11-11 11:56:10,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af8727a23d944548a678ca415ad561fe 2023-11-11 11:56:10,133 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/.tmp/info/b003657ec6f54de58e7683c4324c293a as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/info/b003657ec6f54de58e7683c4324c293a 2023-11-11 11:56:10,137 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b003657ec6f54de58e7683c4324c293a 2023-11-11 11:56:10,137 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/info/b003657ec6f54de58e7683c4324c293a, entries=226, sequenceid=130, filesize=37.9 K 2023-11-11 11:56:10,137 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/.tmp/rep_barrier/65a16df202fa4e99ac9e77b608bc3dff as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/rep_barrier/65a16df202fa4e99ac9e77b608bc3dff 2023-11-11 11:56:10,141 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65a16df202fa4e99ac9e77b608bc3dff 2023-11-11 11:56:10,141 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/rep_barrier/65a16df202fa4e99ac9e77b608bc3dff, entries=1, sequenceid=130, filesize=5.0 K 2023-11-11 11:56:10,142 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/.tmp/table/af8727a23d944548a678ca415ad561fe as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/table/af8727a23d944548a678ca415ad561fe 2023-11-11 11:56:10,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af8727a23d944548a678ca415ad561fe 2023-11-11 11:56:10,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/table/af8727a23d944548a678ca415ad561fe, entries=27, sequenceid=130, filesize=6.6 K 2023-11-11 11:56:10,147 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1252ms, sequenceid=130, compaction requested=false 2023-11-11 11:56:10,150 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-11 11:56:10,151 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-11 11:56:10,151 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-11 11:56:10,151 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-11 11:56:10,151 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-11 11:56:10,297 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41363,1699703601801; all regions closed. 2023-11-11 11:56:10,305 DEBUG [RS:0;jenkins-hbase4:41363] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/oldWALs 2023-11-11 11:56:10,305 INFO [RS:0;jenkins-hbase4:41363] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41363%2C1699703601801.meta:.meta(num 1699703603453) 2023-11-11 11:56:10,309 DEBUG [RS:0;jenkins-hbase4:41363] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/oldWALs 2023-11-11 11:56:10,309 INFO [RS:0;jenkins-hbase4:41363] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41363%2C1699703601801:(num 1699703603294) 2023-11-11 11:56:10,309 DEBUG [RS:0;jenkins-hbase4:41363] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:56:10,309 INFO [RS:0;jenkins-hbase4:41363] regionserver.LeaseManager(133): Closed leases 2023-11-11 11:56:10,310 INFO [RS:0;jenkins-hbase4:41363] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-11 11:56:10,310 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-11 11:56:10,311 INFO [RS:0;jenkins-hbase4:41363] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41363 2023-11-11 11:56:10,319 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41363,1699703601801 2023-11-11 11:56:10,319 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-11 11:56:10,319 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-11 11:56:10,319 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41363,1699703601801] 2023-11-11 11:56:10,320 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41363,1699703601801; numProcessing=1 2023-11-11 11:56:10,321 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41363,1699703601801 already deleted, retry=false 2023-11-11 11:56:10,321 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,41363,1699703601801 expired; onlineServers=0 2023-11-11 11:56:10,321 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41929,1699703600606' ***** 2023-11-11 11:56:10,321 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-11 11:56:10,322 DEBUG [M:0;jenkins-hbase4:41929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d871ec4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-11 11:56:10,322 INFO [M:0;jenkins-hbase4:41929] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41929,1699703600606 2023-11-11 11:56:10,322 INFO [M:0;jenkins-hbase4:41929] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41929,1699703600606; all regions closed. 2023-11-11 11:56:10,322 DEBUG [M:0;jenkins-hbase4:41929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-11 11:56:10,322 DEBUG [M:0;jenkins-hbase4:41929] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-11 11:56:10,322 DEBUG [M:0;jenkins-hbase4:41929] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-11 11:56:10,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1699703602948] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1699703602948,5,FailOnTimeoutGroup] 2023-11-11 11:56:10,322 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-11 11:56:10,322 INFO [M:0;jenkins-hbase4:41929] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-11 11:56:10,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1699703602951] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1699703602951,5,FailOnTimeoutGroup] 2023-11-11 11:56:10,322 INFO [M:0;jenkins-hbase4:41929] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-11 11:56:10,323 INFO [M:0;jenkins-hbase4:41929] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-11 11:56:10,323 DEBUG [M:0;jenkins-hbase4:41929] master.HMaster(1512): Stopping service threads 2023-11-11 11:56:10,323 INFO [M:0;jenkins-hbase4:41929] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-11 11:56:10,324 ERROR [M:0;jenkins-hbase4:41929] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-11 11:56:10,324 INFO [M:0;jenkins-hbase4:41929] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-11 11:56:10,324 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-11 11:56:10,324 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-11 11:56:10,324 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-11 11:56:10,325 DEBUG [M:0;jenkins-hbase4:41929] zookeeper.ZKUtil(398): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-11 11:56:10,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-11 11:56:10,325 WARN [M:0;jenkins-hbase4:41929] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-11 11:56:10,325 INFO [M:0;jenkins-hbase4:41929] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-11 11:56:10,325 INFO [M:0;jenkins-hbase4:41929] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-11 11:56:10,325 DEBUG [M:0;jenkins-hbase4:41929] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-11 11:56:10,325 INFO [M:0;jenkins-hbase4:41929] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 11:56:10,325 DEBUG [M:0;jenkins-hbase4:41929] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 11:56:10,325 DEBUG [M:0;jenkins-hbase4:41929] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-11 11:56:10,325 DEBUG [M:0;jenkins-hbase4:41929] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 11:56:10,325 INFO [M:0;jenkins-hbase4:41929] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.69 KB heapSize=598.84 KB 2023-11-11 11:56:10,420 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-11 11:56:10,421 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): regionserver:41363-0x101d4f9ea0a0001, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-11 11:56:10,420 INFO [RS:0;jenkins-hbase4:41363] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41363,1699703601801; zookeeper connection closed. 2023-11-11 11:56:10,421 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6ce61bb9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6ce61bb9 2023-11-11 11:56:10,421 INFO [Listener at localhost/39241] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-11 11:56:10,733 INFO [M:0;jenkins-hbase4:41929] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.69 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4087d75cf6b0479bb5a10c870f5a2e1e 2023-11-11 11:56:10,736 INFO [M:0;jenkins-hbase4:41929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4087d75cf6b0479bb5a10c870f5a2e1e 2023-11-11 11:56:10,736 DEBUG [M:0;jenkins-hbase4:41929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4087d75cf6b0479bb5a10c870f5a2e1e as hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4087d75cf6b0479bb5a10c870f5a2e1e 2023-11-11 11:56:10,739 INFO [M:0;jenkins-hbase4:41929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4087d75cf6b0479bb5a10c870f5a2e1e 2023-11-11 11:56:10,739 INFO [M:0;jenkins-hbase4:41929] regionserver.HStore(1080): Added hdfs://localhost:42537/user/jenkins/test-data/a46ece98-b795-27bd-e394-0b02e1d4241f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4087d75cf6b0479bb5a10c870f5a2e1e, entries=123, sequenceid=1011, filesize=33.3 K 2023-11-11 11:56:10,740 INFO [M:0;jenkins-hbase4:41929] regionserver.HRegion(2948): Finished flush of dataSize ~512.69 KB/524991, heapSize ~598.83 KB/613200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 415ms, sequenceid=1011, compaction requested=false 2023-11-11 11:56:10,741 INFO [M:0;jenkins-hbase4:41929] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-11 11:56:10,741 DEBUG [M:0;jenkins-hbase4:41929] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-11 11:56:10,743 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-11 11:56:10,743 INFO [M:0;jenkins-hbase4:41929] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-11 11:56:10,744 INFO [M:0;jenkins-hbase4:41929] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41929 2023-11-11 11:56:10,746 DEBUG [M:0;jenkins-hbase4:41929] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41929,1699703600606 already deleted, retry=false 2023-11-11 11:56:10,757 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-11 11:56:10,847 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-11 11:56:10,847 INFO [M:0;jenkins-hbase4:41929] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41929,1699703600606; zookeeper connection closed. 2023-11-11 11:56:10,847 DEBUG [Listener at localhost/39241-EventThread] zookeeper.ZKWatcher(600): master:41929-0x101d4f9ea0a0000, quorum=127.0.0.1:59344, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-11 11:56:10,849 WARN [Listener at localhost/39241] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-11 11:56:10,853 INFO [Listener at localhost/39241] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-11 11:56:10,960 WARN [BP-1248041169-172.31.14.131-1699703597170 heartbeating to localhost/127.0.0.1:42537] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-11 11:56:10,960 WARN [BP-1248041169-172.31.14.131-1699703597170 heartbeating to localhost/127.0.0.1:42537] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1248041169-172.31.14.131-1699703597170 (Datanode Uuid 62de3f35-260d-457c-b3c8-4bf3953a5c73) service to localhost/127.0.0.1:42537 2023-11-11 11:56:10,962 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/cluster_ba247ec2-1551-003a-d119-7315b0da3078/dfs/data/data1/current/BP-1248041169-172.31.14.131-1699703597170] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-11 11:56:10,963 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/cd766ebc-95dd-196d-0e2e-4cac5ba09884/cluster_ba247ec2-1551-003a-d119-7315b0da3078/dfs/data/data2/current/BP-1248041169-172.31.14.131-1699703597170] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-11 11:56:10,989 INFO [Listener at localhost/39241] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-11 11:56:11,122 INFO [Listener at localhost/39241] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-11 11:56:11,202 INFO [Listener at localhost/39241] hbase.HBaseTestingUtility(1293): Minicluster is down